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Abstract 

A  practical  two  aircraft  pursuit-evasion  problem  in  three-dimen- 
sional  space  is  posed  as  a  zero  sum,  perfect  information  differential 
game.  The  purpose  of  the  thesis  is  to  solve  this  differential  game 
and  to  obtain  optimal  or  near  optimal  closed-loop  control  laws  for  the 
two  players. 

Three  models  of  the  aircraft  dynamics  are  used.  The  first  model 
is  primarily  a  realistic  one,  and  as  the  state  equations  jure  non-linear 
and  highly  coupled,  it  is  not  possible  to  obtain  optimal  closed-loop 
solutions.  The  second  model  is  a  simplified  version  of  the  first. 

Using  this  model,  the  solution  is  carried  further  -  the  costate  vari¬ 
ables  are  eliminated  from  the  controls  -  but  closed-loop  solutions 
still  cannot  be  found.  The  third  model  used  has  different  controls 
from  the  other  two,  but  is  roughly  similar  in  nature.  Optimal  closed- 
loop  controls  are  obtained  for  this  model.  The  results  obtained  from 
these  models  show  that  the  three-dimensional  problem  cannot  be  consi¬ 
dered  as  a  simple  extension  of  the  two-dimensional  game.  The  necessary 
inclusion  of  the  bank  angle  or  a  similar  control  introduces  an  extra 
order  of  complexity  into  the  problem. 

As  exact  optimal  closed-loop  control  laws  for  the  realistic  model 
jure  not  available,  the  results  of  the  juialysis  are  presented  in  two  ways. 
Firstly,  open- loop  minimax  solutions  for  all  three  models  jure  generated 
numerically  by  backward  integration  from  a  selection  of  terminal  states. 
Two-dimensional  views. of  these  three-dimensional  trajectories  are  given 
in  both  real  and  relative  space.  Secondly,  pseudo  optimal  controls  for 
the  realistic  model  jure  derived,  based  on  the  closed-loop  controls  ob- 
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tained  for  the  simplest  of  the  three  models.  These  pseudo  controls  are 
then  used  with  the  standard  dynamics  to  integrate  forward  in  time  from 
the  states  reached  by  backward  integration  of  the  realistic  open-loop 
solutions.  The  pseudo  closed-loop  solutions  give  a  good  approximation 
to  the  open-loop  solutions  for  the  realistic  model  under  almost  all  the 


conditions  tested. 
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TOWARD  A  DIFFERENTIAL  GAME  SOLUTION  TO  A  PRACTICAL  TWO-AIRCRAFT 
PURSUIT-EVASION  PROBLEM  IN  THREE  DIMENSIONAL  SPACE 

I.  Introduction 

The  aerial  dogfight  is  a  problem  for  which  no  analytically  derived  . 
optimal  maneuvers  have  yet  been  found.  The  knowledge  of  such  maneuvers 
would  be  of  use  both  in  the  design  and  in  the  operation  of  any  aircraft 
that  might  be  involved  in  aerial  combat,  in  the  field  of  design,  the 
value  of  some  function  such  as  the  time  to  intercept  from  certain 
specified  initial  conditions,  subject  to  optimal  maneuvering  by  both 
combatants,  would  provide  a  good  numerical  indicator  for  use  in  reach¬ 
ing  compromises  between  various  aspects  of  performance.  In  the  field 
of  operations,  it  might  not  be  practicable  to  fly  optimal  trajectories  » 
exactly,  but  a  knowledge  of  them  would  be  helpful  in  developing  and 
evaluating  tactics. 

A  discussion  of  the  merits  and  demerits  of  the  various  methods 
which  may  be  used  to  analyze  the  dogfight  is  given  in  Chapter  II.  This 
thesis  poses  the  dogfight  as  a  zero  sum,  perfect  information,  pursuit- 
evasion  differential  game.  The  purpose  of  the  thesis  is  to  analyze 
this  problem,  and  to  proceed  as  far  as  possible  with  its  solution. 

In  his  doctoral  dissertation  (Ref  4) ,  Othling  considers  the  dog¬ 
fight  as  a  differential  game  where  both  players  are  restricted  to  two- 
dimensional  planar  motion.  He  considers  a  realistic  or  standard  model 
of  the  aircraft  dynamics  for  which  he  obtains  open-loop  controls,  and 
then  goes  on  to  consider  various  simplified  dynamic  models  for  which 
ne  is  able  to  obtain  closed-loop  solutions.  This  thesis  extends  the 
study  to  problems  in  which  three-dimensional  maneuvering  is  permitted. 
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similar  to  that  in  two-dimensions,  and  that  it  would  in  effect  only  re¬ 
quire  an  increase  in  the  number  of  equations  to  be  handled.  However, 
it  was  found  that  the  necessary  inclusion  of  the  direction  of  the  lift 
vector  as  one  of  the  controls  added  considerably  to  the  complexity  of 
the  problem. 

In  order  to  analyze  the  problem,  three  models  of  the  aircraft  dy¬ 
namics  are  developed.  These  models  are  described  in  Chapter  III.  The 
first  model  is  a  realistic  or  standard  representation.  The  second 
model  is  a  simplified  version  of  the  first  model,  but  one  which  re¬ 
tains  the  basic  nature  and  controls  of  the  standard .  The  third  model 
is  a  more  drastically  altered  representation  which  is  aimed  primarily 
at  obtaining  a  closed-loop  solution.  In  Chapter  IV,  the  differential 
gaim»  using  the  standard  dynamic  model  is  investigated,  and  the  solution 
carried  as  far  as  possible.  In  Chapter  V,  the  same  is  done  for  the 
second  dynamic  model.  In  Chapter  VI,  the  differential  game  using  the 
most  simplified  dynamic  model  is  investigated,  and  closed-loop  controls 
are  obtained. 

The  feasibility  of  using  the  closed -loon  controls  developed  for 
the  simplest  model  as  an  approximation  to  closed-loop  controls  for  the 
standard  model  is  examined  in  Chapter  VII.  A  possible  algorithm  for 
deriving  near-optimal  controls  in  a  dogfight  situation  is  also  sugges¬ 
ted  in  this  chapter. 

In  the  course  of  attempting  the  solution  of  the  first  two  dynamic 
■models,  the  author  discovered  a  theorem  which  may  well  be  of  more 
general  use  in  problems  where  the  costate  differential  equations  are 
not  directly  integrable.  This  theorem  and  its  proof  are  given  in 
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Appendix  A. 

Since  it  is  not  expected  that  the  study  of  the  aerial  pursuit- 
evasion  problem  will  cease  with  this  thesis*  results  which  may  be  of 
value  to  other  workers  on  the  problem  are  given  in  Appendices  B  and  C. 
These  results  are  certain  unsuccessful  approximations  to  the  open-loop 
controls  for  the  standard  model*  and  a  series  of  graphical  plots  of 
typical  trajectories  in  real  and  relative  space  for  all  three  models. 
Trajectories  obtained  by  using  the  synthesized  near -optimal  controls 
with  the  standard  dynamics  are  also  shown. 

It  is  felt  that  this  thesis  makes  a  definite  contribution  towards 
finding  optimal  controls  for  use  in  aerial  encounters.  Furthermore  it 
serves  to  show  that  the  use  of  simplified  models  can  be  of  great  value 
in  examining  realistic  problems.  Finally*  for  the  first  time  in  the 
study  of  realistic  differential  game  problems,  results  are  obtained 
which  begin  to  look  as  though  they  might  be  of  direct  applicability. 
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11.  Outline  of  the  Problem 

Purpose  of  the  Thesis 

The  purpose  of  this  thesis  is  to  solve  a  realistic  two  aircraft 
pursuit-evasion  differential  game,  where  the  players  may  maneuver 
freely  in  three-dimensional  space. 

The  problem  is  first  defined  in  terms  of  two  aircraft  with  dynamics 
which  approximate  closely  those  found  in  real  life.  A  closed-loop  solu¬ 
tion  for  this  problem  could  not  and  probably  cannot  be  found,  so  a  se¬ 
lection  of  open-loop  minimax  trajectories  is  generated  numerically, 
and  then  examined  and  compared  with  other  more  approximate  solutions. 

Once  the  most  realistic  or  "standard"  model  has  been  investigated, 
the  aim  is  to  find  the  aircraft  model  which  is  closest  in  its  dynamic 

I 

representation  to  the  standard  and  yet  able  to  be  solved  completely. 

With  this  in  mind,  two  models  are  presented.  The  first  is  a  fixed 
velocity,  zero  gravity  version  of  the  standard  model;  only  open-loop 
solutions  for  this  problem  could  be  found,  but  the  model  is  as  simple 
as  it  is  possible  to  get  whilst  still  retaining  the  basic  nature  of 
the  standard  model.  The  model  for  which  closed-loop  controls  could 
be  found  is  termed  the  "spherical  vectogram  model."  As  the  usefulness 
of  this  model  is  limited  in  so  far  as  it  approximates  the  standard 
model,  only  a  solution  "in  the  small"  (Ref  3:66)  is  presented.  The 
controls  found  from  this  model  cure  used  to  synthesize  pseudo-optimal 
closed-loop  controls  for  the  standard  model. 

The  above  steps  provide  a  significant  advance  in  the  development 
of  realistic  control  laws  for  the  two  aircraft  pursuit-evasion  problem. 
However,  there  is  still  much  work  to  do  in  refining  these  control  laws. 
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and  so  the  final  aim  of  this  thesis  is  to  serve  as  a  background  for 
future  workers  in  the  field,  and  to  document  some  of  the  unproductive 
lines  of  approach  to  the  problem. 

Reason  for  the  Differential  Game  Approach 

The  reason  for  choosing  the  differential  game  approach  to  the  two 
aircraft  pursuit-evasion  problem  is  that  there  is  no  alternative  approach 
which  offers  the  same  possibilities. 

The  concept  of  energy  maneuverability,  which  has  received  a  lot  of 
attention  in  recent  years,  is  only  of  use  in  putting  a  prospective  com¬ 
batant  in  an  advantageous  position  from  which  to  start  an  engagement, 
and  then  in  showing  the  best  way  in  which  to  perform  certain  specific 
predetermined  maneuvers.  There  is  no  guidance  available  as  to  what 
maneuvers  should  be  performed  in  order  to  close  with  the  opponent  and 
effect  a  kill. 

Ordinary  optimization  technirjues  are  not  really  applicable  as  they 
credit  only  one  player  with  the  intelligence  and  ability  to  maneuver 
other  than  along  a  predetermined  flight  path.  This  is  not  to  say  that 
ordinary  optimization  techniques  cannot  yield  useful  results,  but  mere¬ 
ly  that  these  results  are  severely  limited  in  nature. 

"Seat  of  the  pants"  techniques  are  probably  the  best  available, 
but  are  unlikely  to  be  optimal,  and  are  highly  subjective.  Further¬ 
more,  even  if  an  individual  pilot  were  able  to  fly  optimal  trajectories, 
he  would  find  it  most  difficult  to  characterize  these  maneuvers  so  that 
they  could  be  followed  by  another  pilot  (human  or  automatic) . 

In  a  differential  game  both  players  may  maneuver  within  the  limits 
set  by  the  constraints  on  their  controls.  Both  players  strive  to  mini- 
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size  their  costs  expressed  ai  some  integral  of  the  state  variables  and 
controls  during  the  progress  of  the  game  and  some  function  of  the  states 
at  termination. 

The  three  greatest  drawbacks  in  approaching  a  dogfight  as  a  dif¬ 
ferential  game  are: 

1.  During  the  course  of  a  game  the  roles  of  the  players  are 
fixed,  so  that  the  evader  may  not  become  the  pursuer  nor 
may  the  pursuer  become  the  evader. 

2.  Closed-lcop  solutions  are  hard  to  obtain  except  with  simpli¬ 
fied  dynamic  representations,  and  open-loop  solutions  are 
not  in  general  optimal  against  non-optimal  maneuvers  by 

the  other  player. 

3.  Whatever  conditions  are  chosen  to  determine  capture,  or  the 
end  of  a  game,  are  final  and  unless  some  provision  for  it 
is  made  in  the  cost  function,  there  is  no  consideration  of 
the  possibility  of  the  need  for  a  re-engagement. 

However,  it  is  felt  that  these  drawbacks  are  easily  outweighed  by  the 
results  that  may  be  obtained  using  the  differential  game  approach.  It 
must  be  stressed  that  this  is  the  only  method  for  treating  an  encounter 
problem  where  the  players  have  differing  aims  and  are  able  to  use  con¬ 
trols  which  affect  the  outcome  of  these  aims. 

The  parameters  of  a  two  aircraft  pursuit-evasion  problem  are  such 
that  it  may  be  posed  as  a  two-player  perfect  information,  zero-sum  dif¬ 
ferential  game.  Once  the  perfect  information  zero-sum  game  has  been 
solved,  it  may  be  of  value  to  investigate  the  problem  viewed  as  a  non- 
zero-sum  game,  and  to  examine  the  effects  of  imperfect  information. 
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However,  the  first  priority  is  to  obtain  a  solution  to  the  perfect  in¬ 
formation  zero-sum  differential  game,  and  it  is  towards  this  end  that 
this  thesis  is  directed. 

Necessary  Conditions  for  a  Solution 

Necessary  conditions  for  a  saddle-point  solution,  or  set  of  mini- 
max  strategies,  to  a  zero-sum  perfect  information  differential  game 
are  given  in  a  number  of  standard  texts  (Ref  1:277,  Ref  3:67),  and  are 
summarized  below. 

The  differential  game  problem  is  defined  by  the  dynamic  system 
• 

x  -  F(x,u,v,t);  x(t0)  »  xQ  (2-1) 

where  x  is  the  n-dimensional  state  vector,  u  is  the  m-vector  pursuer's 
control  and  v  is  the  p-vector  evader’s  control,  u  and  v  may  or  may  not 
be  subject  to  constraints.  The  game  has  the  terminal  constraints 

*(x(tf),tf)  -  0  (2-2) 

which  define  an  n-dimensional  surface  in  the  (n  +  1) -dimensional  space 
consisting  of  the  n  components  of  x  (tf) ,  and  tf.  The  game  has  the 
performance  criterion,  or  payoff, 

tf 

J  «  ♦  (x(tf),tf)  +  /  L(x,u,v,t)  dt  (2-3) 

t0 

The  aim  is  to  find  the  controls  u*  and  v*  such  that 

J(u*,v)  <  J(u*,v»)  <.  J(u,v*)  (2-4) 

If  u*  and  v*  can  be  found,  the  pair  (u*,v*)  is  called  a  saddle  point 
of  the  game  and  J(u*,v*)  is  called  the  value  of  the  game. 
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The  existence  of  a  solution  is  dependent  on  the  fact  that 

Min  Max  J(u,v)  »  Max  Min  J(u,v)  (2-5) 

u  v  v  u 

A  necessary  condition  for  a  saddle  point  solution  of  the  above 
differential  game  is  that  the  Hamiltonian  defined  by 
_  _T  _ 

H(t,x,X,u,v)  -  X  f  +  L  (2-6) 

must  be  minimized  over  the  set  of  admissible  u  and  maximized  over  the 
set  of  admissible  v  and  that 

H*  «  Max  Mir  H  **  Min  Max  H  (2-7) 

v  u  u  v 

X  is  the  n-dimensional  costate  vector,  and  the  costate  differential 
equations  jure 

X  »  -H£  (2-8) 

the  transversality  conditions  are  given  by 

H(tf)  *  -♦t(tf)7  X(tf)  -  *-itf)  (2-9) 

where  +  (x(tf),tf)  •  $  +  v  T  (2-10) 

and  v  «  arbitrary  constant 

If  t  does  not  appear  explicitly  in  either  H  or  the  control  con¬ 
straints,  then  H  is  constant. 

It  was  previously  stated  that  the  optimal  solution  to  the  dif¬ 
ferential  game  problem  is  the  pair  of  controls  (u*,v*)  which  provides 
a  saddle  point  of  J.  .  If  the  pair  (u*,v*)  is  given  as  (u* (t) ,v»  (t) ) , 
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one  speaks  of  an  open-loop  solution.  If  the  controls  are  expressed  as 
functions  of  the  instantaneous  state  and  tine 


u*  »  ku(x,t) 


(2-11) 


v*  «  kv(x,t)  (2-12) 


one  has  what  is  known  as  a  feedback  or  closed-loop  control  law. 


Payoff  and  Termination  Criteria 

The  basic  type  of  encounter  for  which  the  approach  outlined  in  this 
thesis  is  most  appropriate  is  one  between  two  fighter  aircraft.  The 
armament  of  such  aircraft  would  normally  be  either  air-to-air  missiles, 
or  cannons,  or  both.  It  was  decided  to  use  as  terminal  surface  a 
typical  launch  envelope  for  a  next-generation  short-range  missile.  One 
such  missile  might  have  a  maximum  target  range  of  5000  ft  and  a  minimum 
target  range  of  1500  ft  at  launch.  The  missile  could  be  fired  while 
maneuvering  at  high  load  factors  (e.g. ,  up  to  8g)  and  the  target  should 
lie  within  approximately  120*  c i  the  attacking  aircraft’s  velocity  vec¬ 
tor  at  the  instant  of  firing.  To  simplify  the  problem  the  terminal 
surface  considered  as  equivalent  to  this  is  taken  as  a  sphere  of  radius 
R  »  5000  ft  centered  at  the  pursuer.  Because  of  the  large  arc  of  fire, 
the  loss  of  realism  by  not  considering  the  angular  restrictions  is 
small,  as,  with  the  roles  of  the  aircraft  fixed,  there  will  be  very 
few  minimax  trajectories  in  which  the  evader  flies  into  the  capture 
region  from  behind.  The  terminal  surface  may  thus  be  written  as 


T  5  (xk_xp)  1 2  +  <yE-yP>l2  +  (vzp>  I2  -*2  •  o 

t*tf  t»tf  t«t- 


(2-13) 
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where  in  this  problem  R  «  5000  ft. 

The  payoff  is  taken  as  time  to  capture,  expressed  for  the  purposes 
of  this  thesis  as 

J  »  J  dt  (2-14) 

to 

Payoffs  which  include  the  relative,  energies  of  the  two  players  at- 
termination  as  well  as  the  time  to  capture  may  be  useful  later,  but 
for  the  present  the  aim  is  to  find  a  solution  to  the  realistic  problem 
without  unnecessary  complications. 
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III.  Aircraft  Models 

The  purpose  of  this  chapter  is  to  derive  and  justify  the  state 
differential  equations  used  in  the  three  models  presented  in  this 
thesis. 

The  Standard  Model 

The  aim  of  this  model  is  to  give  as  realistic  a  representation  of 
the  aircraft  dynamics  as  possible  without  undue  complications  of  the 

equations  of  motion.  With  this  in  mind,  the  following  assumptions  are 
made: 

1.  The  aircraft  are  considered  to  be  point  masses. 

2.  The  earth  is  flat  and  the  acceleration  of  gravity  is 
constant . 

3.  The  thrust  of  each  aircraft  is  constant  and  tangent  to 
its  flight  path. 

4.  The  weight  of  each  aircraft  is  constant. 

5.  Lift  and  drag  forces  are  respectively  normal  and  tangent 
to  the  flight  path. 

The  aircraft  equations  of  motion  may  then  be  written  as 


V  cos  y  cos  x 

(3-1) 

V  cos  y  sin  x 

(3-2) 

V  sin  y 

(3-3) 

~  [T  -  D  -  W  sin  y) 

(3-4) 

g  . 

[L  cos  p  -  W  cos  y) 

(3-5) 

11 
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X  «  - 2 -  [L  sin  p)  (3-6) 

VW  cos  Y 

The  state  variables  are  defined  in  Pig.  1.  x,y,z  are  the  coordinates 
of  the  aircraft's  center  of  mass  with  respect  to  a  set  of  inertial  axes. 
V  is  the  aircraft's  velocity,  y  is  the  flight  path  inclination,  and 
X  the  aircraft  heading  angle.  T  is  the  thrust,  D  the  drag,  W  the 
weight  and  L  the  lift  of  the  aircraft,  p  is  the  roll  angle  of  the  air** 
craft  about  its  velocity  vector,  and  is  under  the  pilot's  control. 

The  aerodynamic  forces  are  defined  by 

D  -  %  p  V2  A  Cjj,  L  -  \  p  V2  A  CL  (3-7) 

where  p  is  the  air  density,  A  a  reference  area,  CD  the  drag  coefficient 
and  CL  the  lift  coefficient. 

The  following  further  assumptions  are  now  made: 

1.  The  air  density  p  is  considered  to  be  constant  throughout 
the  airspace  used  in  the  encounter. 

2.  The  pilot  of  each  aircraft  has  direct  control  over  the 
lift  coefficient  C^. 

3.  The  aircraft  have  parabolic  drag  polar s  so  that 

CD  »  k0  +  kj  C l  (3-8) 

where  kQ  is  the  zero-lift  drag  coefficient  and  kj  the  induced  drag 
factor. 

For  notational  simplicity  it  is  convenient  to  define  the  constants 
Kj,  -  Tg/W  (3-9) 
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k„  -  p  Ag/2W  (3-10) 

It  is  also  convenient  to  consider  that  p  is  restricted  to  the  range 
-*/2  <_  p  <.  n/2,  and  that  nay  be  positive  or  negative.  Limits  on 
maneuverability  are  set  by  constraining  CL  such  that 

Since  inverted  flight  is  possible  it  is  sensible  to  set 

'y.  ’  -  cw  <3'12> 

which  is  equivalent  to 

IcJ  (3-13) 

The  aircraft  equations  of  motion  are  now 

x  «*  V  cos  y  cos  x  (3-14) 

y  ■  V  cos  y  sin  x  (3-15) 

z  -  V  sin  y  (3-16) 

V  -  -  kp  (J^  +  )  V2  -  g  sin  y  (3-17) 

Y  «  kDVCL  cos  p  -  g  cos  y/V  (3-18) 

X  -  kDVCL  sin  p/cos  y  (3-19) 

The  2ero  Gravity  and  Fixed  Velocity-Model 

The  aim  of  this  model  is  essentially  to  simplify  the  standard 
model  as  much  as  possible  without  losing  the  basic  nature  of  the  model. 
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The  gravitational  force  on  the  aircraft  is  neglected  since  it  nay 
be  argued  that  it  is  present  only  as  an  acceleration  which  affects  both 
players  equally. 

Each  aircraft  is  assumed  to  have  a  velocity  fixed  in  magnitude. 

This  nay  be  justified  on  the  basis  that  fighter  aircraft  cften  operate 
close  to  the  velocity  that  is  the  maximum  allowable  with  external 
stores.  Changes  in  the  magnitude  of  each  aircraft's  velocity  are  there¬ 
fore  small. 

With  these  two  additional  assumptions,  the  aircraft  equations  of 
notion  are 


x  »  V  cos  y  cos  x 

(3-20) 

y  *  V  cos  y  sin  x 

(3-21) 

z  «  V  sin  y 

(3-22) 

• 

Y  *  °°s  v 

(3-23) 

X  »  *uVCL  sin  v/cos  y 

(3-24) 

The  Spherical  Acceleration  Vectogram  Model 

The  purpose  of  this  model  is  to  yield  a  differential  game  which 
can  be  solved  in  closed  form,  and  yet  has  dynamics  that  are  not  too 
unrealistic.  A  model  that  satisfies  these  requirements  is  one  in 
which  each  aircraft  is  considered  to  be  in  dynamic  equilibrium  except 
for  a  maneuvering  force  of  constant  magnitude  which  the  pilot  may 
apply  in  any  direction  at  will. 

The  dynamic  equations  of  this  model  are 

x  «  Vx  (3-25) 
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y  -  Vy 

(3-26) 

z  ■  Vz 

(3-27) 

vx  -  F£j 

(3-28) 

Vy  »  Fi2 

(3-29) 

vz  -  Pi3 

(3-30) 

where  Vx,  Vy,  Vz  are 

x,y,z  directions.  P 

magnitude.  1j,£2'^3 

and  are  the  player's 

the  components  of  the  aircraft's  velocity  in  the 

is  the  specific  excess  force  and  is  constant  in 

are  the  direction  cosines  of  the  maneuvering  force 

controls. 
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IV. 


_ J  A.  *\4  *1 

nir8UiV~^Vfla*VM 


Ran*  -  standard  Model 


The  purpose  of  this  chapter  is  to  solve  a  differential  game  problem 
using  the  aircraft  dynamics  derived  in  Chapter  III  for  the  standard 
aircraft  model.  The  author  was  unable  to  solve  the  game  completely, 
and  so  closed- loop  controls  are  not  found.  For  the  benefit  of  any 
future  workers  on  this  problem,  the  details  of  the  partial  solution 
are  given,  and  there  is  a  brief  discussion  of  computer  generated  open- 

loop  solutions. 


Statement  of  the  Problem 

The  problem  is  to  determine  a  saddle  point  of 

*f 

J(tf)  »  J  dt 

to 

subject  to 

xp  «  Vp  cos  Yp  cos  xp 
yp  ®  Vp  cos  Yp  sin  xp 
Zp  »  Vp  sin  Yp 

Vp  ®  lojp  -  kDP  (kop  +  kip  cjp)  vf  -  g  sin  Yp 
Yp  «  kDP  Vp  Clp  cos  Wp  -  g  cos  Yp/Vp 
Xp  *  kDP  VP  CLP  sin  VCOS  YP 

and 

xE  s  VE  cos  7e  cos  xE 


(4-1) 

(4-2) 

(4-3) 

(4-4) 

(4-5) 

(4-6) 

(4-7) 

(4-8) 
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yE  «  VE  cos  ye  sin  xE 


*E  “  VE  sin  Ye 


-  kDE  (kgE  +  k1E  C2g)  v|  -  g  sin  ye 


Ye  -  kjjE  VE  Cj^  cos  vz  -  g  cos  Yj/Vg 

Xe  ■  kDE  VE  CLE  sin  Ve/cos  YS 
with  a  terminal  surface  given  by 

*  =  (xp-xg)  |2  +  (yP-yE)  |2  +  (zp-z^  |2  -R2  =  0 

t«*tf  t*tf  t*t. 


(4-9) 


(4-10) 


(4-11) 


(4-12) 


(4-13) 


(4-14) 


The  subscripts  P  and  E  refer  to  the  pursuer  and  the  evader  respectively. 
The  pursuer's  controls  are  C^p  and  Pp,  and  the  evader's  controls  are 
Cyp  and  pg.  The  controls  are  subject  to  the  constraints 


ICLP I  -  CLPnax 


(4-15) 


IcLeI  -  CLEmax 


(4-16) 


and  for  convenience  it  is  considered  that 


-w/2  <.  Up  <.  if/2 


-*/2  <.  pE  <.  »/2 


(4-17) 


(4-18) 


All  the  above  state  variables  and  constants  are  defined  in  Chapter  III. 


Necessary  Conditions 


Applying  the  necessary  conditions  for  a  saddle  point  solution,  the 
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Hamiltonian  H  is  given  by 


H  ■  1  +  AjjpVp  cos  Yp  cos  Xp  +  AypVp  cos  Yp  sin  Xp  +  AZPVP  ®in  Yp 
+  Ayp  IJc^p  “  kjjp  (kQp  +  kjp  Cjp)  Vp  —  g  sin  Ypl 

+  Xyp  (kjjpVpCjj,  cos  yP  -  g  cos  Yp/Vp]  +  ^xp^dpvpclp  s*n  Vp/cos  rp 
+  AxeVe  cos  YE  cos  Xe  +  aYEvE  cos  Ye  sin  Xe  +  X2EVE  sin  YE 
+  A^  tktpjj  -  kDE  (JcqE  +  kIE  Ct.eO  Ve  -  g  sin  ye1 


+  AyE  IkpEVgCj^  cos  yE  -  g  cos  YEAE1 
+  AXEkDEVECLE  S*14  VE^  003  YE 


(4-19) 


The  Hamiltonian  is  to  be  minimized  with  respect  to  the  pursuer’s  con¬ 
trols,  and  maximized  with  respect  to  the  evader's  controls.  As  H  is 
not  linear  in  any  of  the  controls,  the  possibility  of  singular  controls 
is  not  investigated. 

If  CLP  is  in  the  interior  of  its  admissible  range,  then  it  is 
necessary  that 


H 

ff  1 

p 

e 

i 

i 

r  i 


3Cto^ 


(4-20) 


(4-21) 


Applying  these  conditions. 


~ —  =  -2  AypkppkjpC^pVp  +  AypkppVp  cos  yp 


+  A-kjjpVp  sin  v p/aos  yp 


(4-22) 
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and 


3CLP 


-2  AypkopkipVp  >.  0 


(4-23) 


which  gives 


CLP  “  (Ayp  cos  »ip  cos  Yp  +  A^p  sin  yp)/2  AypkjpVp  cos  Yp 


(4-24) 


and,  since  kDp,  kj-p  and  Vp  are  positive. 


XVP 


<  0 


(4-25) 


Thus  the  admissible  control  Cj^p*  that  minimizes  H  is 


V  * 


CLP  if  lCLp!  -  CLPmax  3nd  XVP  -  0 


±  if  the  above  conditions  are  not 

met,  according  to  whichever 
gives  the  smaller  value  of  H 


(4-26) 


Similarly,  if  cle  is  in  the  interior  of  its  admissible  range,  then 
it  is  necessary  that 


3h 


3Cle 


=r  0 


and 


32H 

3cL 


<  0 


(4-27) 


(4-28) 


Applying  these  conditions. 


CLE  =  <XyE  008  VE  008  YE  +  XXE  Sin  UE,/2  WlEVE  008  YI 


(4-29) 
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ana 


*VE  —  ® 


(4-30) 


Thus  the  admissible  control  Ct.p*  that  maximises  H  is 


c  <  s 
LE 


'LEnax 

It  is  further  necessary  that 


CLE  if  lCLE  I  -  CLEmax  3nd  XVE  -  0 

if  the  above  conditions  are  not 


±  CT 


met. according  to  whichever  gives 
the  smaller  value  of  H 


3H 

3lJt 


«  0 


and 


32H  >  n 


3  Up 


(4-31) 


(4-32) 


(4-33) 


Applying  these  conditions. 


3H 


—  =  “AYpkjjpVpCu  sin  »*p  +  XXpkDPVPCLP  COS  ^i/0055  Yp  =  0 

(4-34) 


and 


o2u 

- —  =  “^yp^DP^P^LP  cos  ^P  "^yp^DP^P^LP  s^n  Vv/cos  yp  >_  0 

H 

(4-35) 

These  conditions  are  satisfied  if  C^p  =  0,  in  which  case  the  value  of 
Up  has  no  physical  significance.  Otherwise  the  admissible  control  y* 
that  minimizes  H  is  given  by 


sin  uj  =  -\P  sgn  £  cos  Yp]y/V*2p  +  >2p  0052  YP  (4_36) 
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cos  yj  -  -Axp  cos  yp  sgn  £  C^p  cos  Yp]  /\A*p  +  A*p  cos2  Yj 


It  is  also  necessary  that 


iiL*  o 


(4-37) 


(4-38) 


(4-39) 


Applying  these  conditions,  the  admissible  control  y*  that  maximizes 


II  is  given  by 


sin  y*  =  XxE  sgn  [c^  cos  ye]  +  **E  cos2  y£  (4-< 

COS  yE  =  XYE  003  YE  Sgn  [  CLE  TOS 


(4-41) 


If  both  of  the  pursuer's  controls  are  on  the  interior  of  their 
admissible  sets  it  is  further  necessary . that  the  matrix 


aCjjpBpp 


SUpdC^p 


is  non-negative  definite.  In  order  to  examine  this,  it  is  noted  that 


3cLP^t 


=  -AYpkDpVp  s*n  Up  +  AxpkopVp  cos  yp/cos  Yp 


(4-42) 
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But 


3H 

Slip 


«  0 


(4-43) 


so  that 


32H 


32H 


SPpSCLp 


=  0 


(4-44) 


and  thus  satisfaction  of  the  individual  necessary  conditions  on  Cjj? 
and  tip  ensures  that  the  above  matrix  is  non  -negative  definite.  A 
similar  proof  holds  for  the  evader's  controls. 

The  costate  equations  cure 


AXP  ** 


Ayp  = 


3H 

3xp 

3H 

3yp 


=  o 


»  0 


(4-45) 


(4-46) 


VZP 


v- 


3H 

3*p 


3H 

3vT  *  "xxp  005  yp  005  xp  "xyp  005  yp  sin  *p 


^  ^VP^DP  ^OP  +  ^IP^Lp)  ^P 
2 

— Xyp  g  cos  Yp/Vp  "AyphnpCT.p  cos  tip 
~XXPknPCLP  s*n  Vp/cos  Yp 


(4-47) 


(4-48) 


•  _3h 

AyP  -  — —  =  xxpVp  sin  yp  cos  Xp  +  AypvP  s^n  Yp  sin  xp 

~XZPVP  COS  YP  +  \rc>  g  003  YP  "XyP  g  sin  YP/VP 
-XXPkDPVPcLP  sin  yP  s-n  Yp/cos2  Yp 


(4-49) 


A..„  = 


-3H 


XP  3Xp  XP  P 


“  XVPVP  cos  Yp  sin  Xp  -  AypVp  cos  Y0  cos  x0  (4-50) 
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The 


-an 

~ —  *  o 

°*E 


-dH 

r —  «  o 

3yE 


(4-51) 


(4-52) 


(4-53) 


A  a  ~9H 

Vs  "  avE  *  ~AXE  cos  rE  cos  xE  -XYE  cos  yb  sin  xE 

"AzE  Sin  YE  +  2AVE*DE  %E  +  kjE  Cfg)  VE 

'AYEkDECLE  cos  ME  -AyE  g  cos  yE/v| 

“AXEkDECLE  sin  Up/cos  Yp 

*  (4-54 

A  a  ~3H 

YE  3Yfi  AXEVE  Sin  yE  005  XE  +  A^  sin  ye  sin  xE 
-AzeVe  COS  YE  +  Ay£  g  cos  ye  -AyE  g  sin  ye/Ve 
"AXEkDEVECLE  Sin  %  sin  YE/cos2  ye  (4_55) 

j  -  -9K  .  ,  tr 

XE  3XE  XE  E  C°S  YE  Sin  *E  “AYEVE  cos  Ye  cos  xE  (4-56) 


transversality  conditions  give 


H(tf }  a 

H(t) 

=  0 

(4-57) 

AXP^fcf  J 

=  2v 

(Xp-X*»)  !  a 

~\\p  (tp) 

(4-53) 

AYP (^f ) 

=  2v 

(yp-yE) !  = 

t=tf 

~AYE (^f ) 

(4-5?) 

A2P  * 

=  2v 

(zp-zE) 1 

t=tf 

~AZE  fcf ) 

(4-60) 

Agpttf) 

a  0  = 

>VE{tf> 

(4-61) 

GA/MC/71-5 


A^p(tj)  s  0  »  A^g(tf) 


(4-63) 


where  v  is  an  arbitrary  constant. 


Partial  Problem  Solution 

In  order  to  evaluate  v,  the  terminal  values  of  the  state  and  co¬ 
state  variables  are  substituted  into  H,  to  give 


H(tf)  =  1  +  2v  C(Xp-xE)  Vp  cos  Yp  cos  xpl I 


+  2v  I (yp-yE)  Vp  cos  Yp  sin  Xpl I 


+  2v  I (Zp-zE)  Vp  sin  Ypl { 

t=tf 

-  2v  [  (xp-xE)  VE  cos  Ye  cos  XeI I 

t> 

-  2v  I (yp-yE)  v£  cos  YE  sin  xEl i 

t? 

-  2v  [ (Zp-zE)  VE  sin  ye1 I 


and  hence 


(4-67) 


2v  a  l/{  (Xp-XE)  {VE  cos  Ye  cos  Xe  “  vp  cos  Yp  COS  Xp) 
+  (yp-yE) (Ve  cos  Ye  sin  Xe  ~  vp  cos  Yp  sin  Xp) 

+  (Zp-ZE) (VE  sin  Ye  ~  Vp  sin  Yp) ) I 


(4-68) 


or  more  simply 


2v  «  -i/{ (Xg-Xp) (Xg-Xp)  +  (yE-yp) (yE-yp)  +  (zE~zP) (ZE_ZP) *  1 


(4-69) 
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Integration  of  Eqs  (4-45),  (4-46),  (4-47),  (4-51),  (4-52)  and  (4-53) 


gives 

AXP  (t)  *»  ^xp(tf)  (4—70) 

Ayp(t)  ■  ^Yp(tf)  ^ 

» 

Agptt)  “  A23P<tf>  (4“72) 

“  ^XE^f ^  (4-73) 

Ay^t)  »  Ay^tf)  (4-74) 

Agg  Ct)  e  (4-75) 

Eq  (4-50)  may  be  written  as 


•  •  • 

Axp  «=  Xxp  yp  -  Xyp  xp  (4-76) 

which  may  be  integrated  to  give 

AxP(t)  =  Xj{p  (tf )  (yp(t)  -  yp(tf)]  -Xyp(tf)  (xp(t)  -  Xp(tf)] 

(4-77) 

Similarly 

XxE(t)  =  Xxg(tf)  tyE(t)  —  yg(tf))  -^YE^f)  lxE(t)  —  Xg(t^)] 

(4-78) 

One  further  relationship  may  be  obtained  by  using  the  fact  that  the 
part  of  the  Hamiltonian  which  contains  only  the  pursuer’s  states  re¬ 
mains  constant  (see  Appendix  A  for  details) ,  or 
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iAXPXp  4  Aypyp  4  A^pZp  +  AypVp  4  XypYp  +  A^pXpJ j 

*  P'XpXp  +  ^YPVP  +  *ZP2pl  I 


which  gives 


(4-79) 


*VP  (t)  (kjp  “  ^dp  ^OP  ^  ^tp^t.p^  ~  9  sin  Ypl  | 

t 

♦  >Yp (t)  (kppVpCLp  cos  Up  -  g  cos  Yp/Vpl | 

t 

=  Ajjp  (tf )  [Vp  cos  Yp  cos  Xpl  -  Vp  cos  Yp  cos  Xp|j 

t«tf  t 

4  Ayp(tf)  [Vp  cos  Yp  sin  Xpl  -  Vp  cos  Yp  sin  Xpll 

t^t^  t 

4  Azp(tf)  [Vp  sin  Ypl  -  Vp  sin  Ypl)  (4-80) 


Similarly- 


*VE^  f^TE  -  kDE  ()CqB  4  kTECTP)  v|  -  g  sin  YE1  | 

t 

+  *yE(t)  [kjjgVpCj^  cos  PE  -  g  cos  YEAE1 1 

t 

*  JVE  COS  YE  COS  XE^  ~  VE  008  YE  009  XE^ 

t=t  jr  t 

4  ^YE (tf )  lVE  cos  ye  sin  xE|  ~  VE  cos  YE  sin  xEll 


+  lvE  sin  yeI  -  Vp  sin  Ypjl 


E  'E' 


(4-81) 


The  author  was  unable  to  find  a  method  of  integrating  Eos  (4-48) , 
(4-49),  (4-54)  and  (4-55)  other  than  numerically. 
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Examination  of  Open-Loop  Solutions 

At  this  stage  the  coordinate  axes  are  still  free  to  be  located 
anywhere  in  space.  In  order  to  examine  the  minimum  number  of  para¬ 
meters  required  to  define  the  terminal  states,  it  is  convenient  to 
locate  the  origin  of  the  coordinate  axes  at  the  terminal  position  of 
the  pursuer.  The  direction  of  the  z-axis  is  fixed  by  the  local  gravity, 
but  the  x— axis  may  be  rotated  about  the  z-axis  until  the  direction  of 
the  pursuer's  velocity  vector  at  termination  lies  in  the  xz-plane. 

There  are  then  seven  parameters  required  to  define  the  terminal  values 
of  the  state  variables.  The  seven  parameters  Si  to  S 7  are  shown  in 
Fig.  2.  Si  and  S2  give  the  magnitude  and  direction  of  the  pursuer’s 
velocity;  S3  and  S4  give  the  position  of  the  evader  relative  to  the 
pursuer;  S5,  Sg  and  S7  give  the  magnitude  and  direction  of  the  evader's  1 
velocity. 

In  terms  of  these  parameters  the  values  of  the  state  variables  at 
termination  are  given  by 


Xp(tf)  «  0 

yp(tf)  -  0 

Zp(tf)  *  0 

vp(tf)  =  Sj 

Ypttf)  =  S2 


Xp(tf)  -  0 


Xgttf)  =  R  cos  S3  cos  S^ 


(4-82) 

(4-83) 

(4-84) 

(4-85) 

(4-86) 

(4-87) 

(4-88) 
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E  is  evader's  position 


?igure  2.  Definition  of  Terminal  Parameters 


GA/MC/71-5 


yE(tf)  ■  R  cos  S3  sin  S4 

(4-89) 

zE(tf)  =  R  sin  S3 

(4-90) 

VE(tf>  =  s5 

(4-91) 

yE(tf)  *  S6 

(4-92) 

Xg(t£)  a  S7 

(4-93) 

A  requirement  for  the  useable  part  0 

3:83)  is  that 

f  the  terminal  surface  (Ref 

min  max  r  <.  0 

cUPf  **P  CLE'  yE 

(4-94) 

.  *  dr 

where  r  «  — 

dt 

(4-95) 

and  r2  *  (xE-xp)2  +  (yE-yP)2  +  (zE-2p)2 

(4-96) 

• 

However,  the  instantaneous  value  of  r  is 

pursuer's  or  the  evader’s  controls,  and 

independent  of  either  the 

so  the  above  condition  merely 

states  that  the  pursuer  must  be  closing  on  the  evader  at  termination. 

In  terms  of  the  terminal  parameters,  the  boundary  of  the  useable  part 
is  given  by 

S5(sin  S3  sin  S6  +  cos  S3  cos  S6  cos  (S7-S|,)J 

**  Sjfsin  S2  sin  S3  +  cos  S2  cos  S3  cos  S4J  (4-97) 

As  the  author  has  been  unable  to  solve  the  problem  for  closed- 
loop  control  laws,  the  next  step  is  to  examine  a  number  of  open  loop 
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minimax  trajectories  integrated  backwards  in  time  from  the  terminal 
surface.  This  does  not  constitute  a  solution  of  the  problem ,  as  with 
seven  terminal  parameters  it  is  quite  impractical  to  map  all  of  free 
space.  However,  the  solutions  obtained  are  of  use  in  examining  the 
validity  of  simplified  models,  and  in  determining  the  sensitivity  of 
the  solutions  to  the  individual  terminal  parameters. 

Projections  of  four  typical  trajectories  are  shown  in  Appendix  C. 
The  projections  were  plotted  using  the  three-dimensional  Cal  comp  rou¬ 
tine  (Ref  2:1  et  seq) .  The  trajectories  are  shown  both  in  real  space, 
and  in  relative  space  where  the  origin  is  fixed  at  the  pursuer. 

Examination  of  a  large  number  of  trajectories  by  the  author  re¬ 
vealed  no  discernible  pattern  in  the  values  of  the  bank  angles.  Moving 
forward  in  time,  the  coefficients  of  lift  remained  at  their  maxima 
(either  positive  or  negative)  unless  a  tail-chase  situation  was  being 
approached,  when  they  reduced  smoothly  and  monotonically  towards  zero. 
The  pursuer's  and  the  evader's  lift  controls  did  not  in  general  move 
away  from  their  limits  at  the  same  _  istant.  In-plane  approximations 
to  the  solution  are  not  considered  valid,  as  even  a  small  out  of  plane 
component  at  termination  indicated  large  out  of  plane  maneuvers  had 
been  performed.  Trajectories  terminating  with  angular  parameters  in 
the  order  of  1  radian  away  from  the  tail-chase  configuration  could 
only  be  integrated  backwards  in  time  for  a  few  seconds  (typically 
about  5  sec)  before  the  aircraft  velocities  became  unrealistically 
large. 

It  had  been  hoped  as  an  alternative  approach  to  fit  artifieally 
generated  closed-loop  controls  to  these  trajectories  by  a  least 
squares  fit.  A  number  of  possible  control  laws  were  fitted  to  one 
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trajectory  (sae  Appendix  B  for  details)  and  then  tested  on  other  tra¬ 
jectories.  Unfortunately,  although  it  was  possible  to  fit  some  of  the 
trial  functions  to  any  one  of  the  open-loop  solutions  with  an  error  in 
the  synthesized  controls  of  less  than  1%,  the  approximation  became  very 
poor  (typical  evror  100%)  when  the  terminal  parameters  were  altered 

significantly. 

Before  passing  the  problem  to  the  computer  for  solution,  it  should 
be  noticed  that  the  lift  and  bank  angle  controls  are  at  present  unde¬ 
fined  at  t  »  tf.  Applying  L* Hospital's  rule 


C^p(tf) 


li®  {  (XyP  cos  yp  cos  Yp  +  *xp  sin  WP>/2XVPkIPvP  cos  Tp) 
tr*tf 

I(XYP  cos  tip  cos  Yp  +  xxp  sin  Vp^XypkjpVp  cos  YP1 1 

(4-98) 


and 


tan  y£(tf) 


lira  (Xxp/XYp  cos  Yp> 

t+tf 

(XXp/XYp  cos  Y  1 1 

t*tf 


(4-99) 


Similarly 


[(XyE  cos  t»E  cos  Ye  +  XXE  sin  ^E)/2XVEkIEVE  °°s  ye)| 


t=tf 
M— lOOt 


and 


tan  v* (tj)  *  Ixxe/xye  cos  ^  ^ ' 


(4-101) 


t-t. 


In  certain  cases,  one  such  being  S2  »  S3  «  S4  =  S6  ®  S7  »  0,  the  above 
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expressions  are  still  undefined  since  ^  »  iy  ■  0.  This  corresponds 

to  the  case  of  terminating  with  singular  controls.  The  possibility  of 
singula?.-  controls  was  not  investigated  further,  since  in  the  time  avail¬ 
able  it  was  considered  more  desirable  to  continue  the  search  for  a  solu¬ 
tion  "in  the  small"  than  to  investigate  the  various  surfaces.  However, 
if  the  reader  is  himself  investigating  any  trajectories  terminating 
near  the  direct  tail-chase  he  should  beware  of  this  problem. 
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V.  Pursuit-Evasion  Differential  Game-Zero  Gravity  and 

Fixed  Velocity  Model 

The  purpose  of  this  chapter  is  to  solve  a  differential  game  problem 
using  the  aircraft  dynamics  derived  in  Chapter  III  for  the  zero  gravity 
and  fixed  velocity  model.  Although  this  is  the  most  drastically  simpli¬ 
fied  model  which  can  be  found  that  retains  the  basic  nature  of  the 
standard  model  and  its  controls,  the  author  was  still  unable  to  solve 
for  closed-loop  controls.  It  is,  however,  possible  to  solve  for  the 
controls  in  terms  of  the  terminal  values  of  the  state  variables,  by 
eliminating  the  costate  variables  from  the  problem. 


Statement  of  the  Problem 


The  problem  is  to  determine  a  saddle  point  of 


J(tf)  «=  /  dt 
t0 


(5-1) 


subject  to 


Xp  -  Vp  cos  Yp  cos  Xp 

(5-2) 

• 

yp  ®  Vp  cos  Yp  Sin  xP 

(5-3) 

• 

Zp  *  Vp  sin  Yp 

(5-4) 

\  -  Vpcif  «*  "p 

(5-5) 

• 

X  *  k  V  C  sin  p  /cos  Y 

P  DP  P  LV  P  P 

(5-6) 

• 

XE  *  VE  003  yE  003  XE 

(5-7) 
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• 

yE  -  VE  cos  yE  sin  Xe 

(5-8) 

*E  *  VE  Sin  YE 

(5-9) 

YE  “  kDEVECLE  COS  WE 

(5-10) 

• 

Xe  “  kDEVECLE  sin  Vcos  YE 

(5-11) 

where  VE  and  Vp  are  constant,  and  where  the  terminal  surface  is  given 

T  s  (xp-xE)|2  +  (yP-yE) | 2  +  (zp-2E)|2  -  r2  =*  o  (5-12) 

t*tf  t=t£  ts*tf 

The  subscripts  P  and  E  refer  to  the  pursuer  and  the  evader  respectively. 
The  pursuer's  controls  are  C^p  and  |ip  and  the  evader's  controls  are  CTK 

and  uE.  The  controls  are  subject  to  the  constraints 


lCIfl  iCLIW  <**«> 

% 

IcLeI  —  CLEmax  (5-14) 

and  as  before  it  is  considered  that 

-*/2  <_  vP  <_  »/2  (5-15) 

-■a/2  <_vE±  */2  (5-16) 


Necessary  Conditions 

Applying  the  necessary  conditions  for  a  saddle  point  solution,  the 
Hamiltonian  H  is  given  by 
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H  »  1  +  *xpVp  cos  YP  cos  Xp  +  XYPVP  008  YP  sin  XP  +  XZPVP  sin  YP 
+  XypiCnpy pCyp  cos  pp  ^  a  yp^ppVpCy.p  sin  yp/cos  Yp 

+  XXEVE  cos  Ye  COS  Xe  +  X'/EVE  cos  yE  sin  Xe  +  XZEVE  sin  YE 
+  XyE*DEVe£lE  008  VE  +  XxEXDEVECLE  S^n  Pe/cos  yE  (5-17) 

The  Hamiltonian  is  to  be  minimized  with  respect  to  the  pursuer's  con¬ 
trols,  and  maximized  with  respect  to  the  evader's  controls. 

Exactly  as  in  Chapter  IV  with  the  standard  model,  the  necessary 
conditions  on  pp  are  satisfied  if  Cjj,  —  0,  in  which  case  the  value  of 

Pp  has  no  physical  significance .  Otherwise  the  admissible  control  pp 
that  minimizes  H  is  given  by 

sin  p*  »  -Axp  sgn  £  C^p  cos  Ypjy^/l^p  +  AyP  cos2  Yp  (5-18) 

cos  pp  »  -XYp  cos  YP  sgn  £  C^p  cos  ypJ  +  Xyp  °°s2  YP  *5~19' 

with  the  possibility  of  a  singular  control  in  Pp  if  Ayp  *  >xp  =  0  for 

a  finite  time.  Similarly  the  necessary  conditions  on  pE  are  satisfied 
if  CTK  «  0,  in  which  case  the  value  of  uE  has  no  physical  significance. 

Otherwise  the  admissible  control  p*  that  maximizes  H  is  given  bv 

E 


Slft  PE  =  V  Sgn  [  CLE  005  Ye]AxE  +  X?E  °°Sy  YI 


cos  p 


(5-20) 


*  “  \e  COS  YE  sgn  LCLE  COS  Y1 


:]/'Xxe  +  x«  0052  ye  <5-21> 


with  the  possibility  of  a  singular  control  in  pE  if  XyE  =  *xE  =•  0  for 
a  finite  time. 
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Both  Cjj,  and  Cjj.  appear  linearly  in  H,  so  it  is  convenient  to  de¬ 
fine  switching  functions  5p  and  Sg  such  that 


and 


Sp  =  XyP  cos  Up  +  X^p  sin  Up/cos  Yp 


SE  =  Xy£  cos  Ug  +  X^E  sin  Ug/cos  Yg 


(5-22) 


(5-23) 


The  minimax  controls  CL  are  then  given  by 


CLP*  =  -  cLPmax  sgn  tsPJ 


CLE*  *  CLEroax  s^n  (%! 


(5-24) 

(5-25) 


with  the  possibility  of  singular  controls  in  C^p  and  Cj^  if  Sp  *  0, 

or  SE  =  0  for  a  finite  time. 

The  costate  equations  are 


XXP  »  0 


(5-26) 


Xyp  -  0 


(5-27) 


XzP  c  0 


(5-28) 


XYP  "  axpvp  Sin  YP  cos  XP  +  xypvp  Sin  YP  sin  XP 

-XgpVp  cos  Yp  -X^kQpVpCkp  sin  Up  sin  Yp/cos2  Yp  (5-29) 


and 


Xxp  =  XXpVp  cos  Yp  sin  Xp  ~XYPtxP  cos  Yp  cos  Xp  (5-30) 


AXE  "  0 


(5-31) 
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A^  «  0  (5-32) 

Ajje  "  ®  (5-33) 

XyE  “  XXEVE  sin  *E  COS  XE  +  XYEVE  sin  *E  sin  XE 

"XZEVE  cos  YE  “XXEkDEVECLE  sin  VE  sin  YE/cos2  YE  (5-34) 

XXE  *  XXE^E  cos  YE  s*n  XE  “XYEVE  cos  YE  cos  xE  (5-35) 


The  transversality  conditions  give 


H(t£)  -  H(t)  «=  0 

(5-36) 

xXp(tf)  *  2v  (xp-xE) j 

1  "XXE^f^ 

(5-37) 

t=t£ 

xyp (tf )  -  2v  (yP-yE) | 

~XYE  (tf  ) 

(5-38) 

t*tj 

XZP  ^f  ^  "  2v  (Zp-ZE)  J  * 

-xZE (t£) 

(5-39) 

t=tf 

XYP(tf)  *  0  =  XYE<tf) 

(5-40) 

xxP(t£)  —  o  =  xxE(tf) 

(5-41) 

where  v  is  an  arbitrary  constant. 

Partial  Problem  Solution 

The  possibility  of  singular  controls  is  first  investioated .  "ne 
necessary  condition  for  a  singular  control  in  C^p  is  that  Sp  =  0  for 
a  finite  time,  which  gives 
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Thus  the  only  possibility  for  a  singular  control  in  Cjj>  is 

CLP*  ■  0,  Wp  of  no  significance  (5-50) 

An  identical  argument  may  be  used  to  show  that  the  only  possibility  for 
a  singular  control  in  is 

CLE*  *  0,  pE  of  no  significance  . (5-51) 


Now  in  order  to  solve  the  costate  equations  it  is  necessary  to 
evaluate  v,  which  must  satisfy  the  following  equation: 

H(tf)  *»  1  -2v  C(xE-Xp)  Vp  cos  Yp  cos  x  1  I 

trtf 

-2u  t (yE-yP)  Vp  cos  Yp  Sin  Xpl I  -2v  ( (zE-zp)  Vp  sin  Ypl ! 

t=tf  t=tf , 


+2v  [  (^-Xp)  VE  cos  ye  cos  xEJ  I 

t^tf 

+2v  [ (yE-yp)  VE  cos  ye  sin  xE) I  +2v  (zE-zp)  v£  sin  ye) | 

t=tf  t=tf 

■  0  (5-52) 


and  hence 

2v  =  -l/{ (xE-xp) (xE-xp)  +  (yE-yp) (yE-yp)  +  (zE-zp) <zE~zp) } | 

t=tf 

(5-53) 

Integration  of  Eqs  (5-26),  (5-27),  (5-28),  (5-31),  (5-32)  and  (5-53) 
gives 


lxp(t)  «= 


(5-54) 
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Xyp(t)  =  (5—55) 

^2p(t)  =  ^2P^f)  (5—56) 

XXE(t)  “  XXE(tf>  (5-57) 

XYE(t)  =  XYE(tf)  <5-58) 

XZE(t)  "  X2E(tf)  <5~59> 


Eq  (5-30)  may  be  rewritten  as 


XXP  =  XXPVP  “Xypxp 


(5-60) 


which  nay  be  integrated  to  give 


Xxp(b)  —  Xjjp(t£)  [yp(t)-yp(t£)J  — Xyp(t£)  [xp(t)-xp(tf)) 


(5-61) 


Similarly 


)yE  -  xxE<^f^  [yg(t)~ y^  (tf )  J  -^YE(tf)  [xg(t)-xp.(tj)] 

(5-62) 

The  remaining  costate  variables  may  now  be  found  by  using  the  fact 
that  that  part  of  the  Hamiltonian  which  contains  only  the  pursuer’s 
(evader’s)  states  remains  constant  (see  Appendix  A  for  details),  or 

•  •  •  •  *. 

(XxpXp  +  Avpyp  +  XgpZp  +  XypYp  +  A^pXp] I 

t 

•  •  •  , 

3  [Axt)Xp  +  Xypyp  +  AzpZp]  |  (5—63) 


which  gives,  on  non-singular  arcs 
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ayP  it)  =  xxp(tf)  +  fyp(tf)-yp(t)] 

+  xZP(t£)  I2p  (tf)  -zp  (t)  ]  ~^xp^£^  [yp(t)-yp(tf)l  Xp(t) 

+  Xyp(tf)  [xp(t)-xp(tf)J  Xp  Ct)  /Yp(t)  (5-64) 

where  all  the  above  terns  are  known  as  functions  of  the  current  and 
terminal  values  of  the  states,  and  of  the  controls.  The  known  values 
have  not  been  inserted  in  Eq  (5-64)  for  the  benefit  of  clarity. 

Similarly 

\e(0  -  flxE(t£>  <*E(l£>-*£<t»  ♦w*’  (yEitf>-yE(t,) 

•  • 

+  XZE(tf)  tzr(tf)-zr(t)]  ->vE(tf)  [yE(t)-vK(tf)]  xE(t) 

+  ^YE^f }  I^^-Xgttf)]  XE(t)|  /YE(t)  (5-65) 

Substitution  of  these  values  of  the  costates  into  the  expression 
for  the  bank  angles,  when  not  on  a  singular  arc  yields 

sin  p*  =  kDpVpCLp*  (xE-x0) j  ryp(t)-yp(tf))  -  (yE-yp)|  [xp(t)-xp(tf ) 

l  t=tf  t=tf 

/cos  Yp  (xE-xp) j  [xp (tf )-xp(t))  +  (yE-vp) |  [yp(tf)-yp(t)] 

L  t=tf  t=tf 

+  <VZP^  IZp(tf)-zp  (t)J  (5-66) 

t=tf 

where  Cjj,*  =  ±  CLPnax,  and 
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sin  \  m  kBEvEci£*  [  (XE*V!  -E(t!“yE{tf)3  ”  W'  iXs(t)-xE(tf)] 

fc  L  t-tf  t-tf 

ycos  ye  ^(Xg-Xp)!  tx^tfj-x^t))  +  (yE-yp)|  IyE(tf)-yE(t)J 

+  (zE“2p)  |  (zE(t£>-ZE(t)]  I 

t-tf  j 


(5-67) 


where  C^*  =  ±  Cjj^. 

Now  in  order  to  investigate  the  switching  function  Sp,  on  non- 
singular  arcs 


Sp  *  cos  |ip  (A^p  +  Axp  tan  yp/cos  Yp) 

-  cos  Up  {  A2p  cos2  Yp  +  Xxp)/\p  cos2  YP 


and  since  -ir/2  <.  pp  <.  tt/2 


Sp  ^  0  if  Xyp  ^  0 


Sp  <  0  if  AYp  <  0 


where  A^p  is  given  by  Eq  (5-64) .  Similarly 


(5-68) 


(5-69) 


(5-70) 


yE  >  0 

(5-71) 

ye  >  0 

(5-72) 

where  A^E  is  given  by  Eq  (5-65) . 

On  singular  circs,  the  condition  that  that  part  of  the  Hamiltonian 
containing  only  the  pursuer's  states  should  remain  constant  gives, 
since  A^p  »  A^p  «  0 


a 
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Ajjpttf)  IXp(t)-Xp<t£)]  +  Xyp(tf)  [yp(t)-yp(tf)} 

+  Azp(tf)  Izp(t)-zp(tf))  «  0  (5-73) 

or 

(xE-xp) |  fxp{t)-xP(t£>]  +  (yE-yp) |  typ(t)-yp(tf) J 
t»tf  t=t£ 

+  <zE-zp)|  fzp(t)-zp(tf)]  *  0  (5-74) 

t**t£ 

and,  similarly  for  the  evader 

(Xg-Xp)}  IXg  (t)  — Xg  (t£ ) )  +  (yE-yp)|  (yE(t)-yE(tf)J 

t=t£  t=tf  ^ 

+  <ZE-Zp)|  [zE(t)-zE(tf)l  =0  (5-75) 

t=»t£ 

Both  the  pursuer's  and  the  evader's  controls  and  associated 
switching  functions,  both  on  and  off  singular  arcs,  have  now  been 
expressed  in  terms  of  the  current  and  terminal  values  of  the  state 

I 

variables'. 

Examination  of  Open  Loop  Solutions 

At  first  sight  it  would  seem  that  the  fact  that  the  costate 
variables  have  been  eliminated  from  the  solution  of  this  problem  would 
greatly  simplify  the  mapping  of  free  space.  However,  closer  scrutiny 
reveals  that  unless  it  is  possible  to  integrate  the  state  equations 
forward  in  time  and  so  eliminate  the  values  of  the  states  at  termina¬ 
tion,  no  great  simplification  ensues.  The  author  was  only  able  to 
integrate  the  state  equations  forward  along  the  singular  arcs,  which 
are  of  constant  velocity  vector,  and  so  open-loop  solutions  for  any¬ 
thing  other  than  trajectories  composed  only  of  singular  arcs  must  still 
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be  generated  by  backward  nunerical  integration  from  the  terminal  sur¬ 
face  . 

For  comparison  with  the  results  of  the  standard  node!  it  is  con¬ 
venient  to  use  the  same  terminal  parameters  as  in  Chapter  IV  (see 
Fig.  2) .  In  this  case  and  S5  are  not  terminal  parameters  but  prob¬ 
lem  parameters.  The  values  of  the  state  variables  at  termination,  and 
the  boundary  of  the  useable  part  at  termination  are  exactly  as  given 
in  Eqs  (4-82)  to  (4-97) . 

‘  On  the  terminal  surface ,  Sp  *  0  instantaneously  so  Cjj>* (tf)  is 
given  by 


f  CbPmax  >  0 


cijpMtf)  =  {  sP«t^<  0 


Sp(tf)  =  0 


(5-76) 


and  similarly 


I  ClJW,  =E(‘£l  <  0 


v(v  •  { 


max 


SE(tf)  -  0 


(5-77) 


As  with  the  standard  model 


tan  Pp(tf)  =  (Xxp/XTp  cos  yp1 


t=t. 


(5-78) 


and 
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•  • 

tan  Pg(tf)  »  tXxE/XyE  cos  yeJ  j  (5-79) 

t-tf 

When  comparing  the  trajectories  obtained  from  this  model  with 
those  of  the  standard  model,  it  should  be  remembered  that  gravity  has 
been  neglected  in  this  case  since  it  affects  both  players  almost 
equally.-  Thus  the  backward  trajectories  for  the  zero  gravity  case 
should  be  imagined  displaced  vertically  a  distance  %  g(tj-t)2  when 
viewed  in  real  space.  With  this  fact  in  mind,  the  trajectories  ob¬ 
tained  from  this  model  and  the  standard  model  sure  in  most  cases  very 
similar.  The  exceptions  are  those  trajectories  finishing  very  close 
to  a  horizontal  tail  chase  configuration  (Figs.  3  and  4).  The  reason 
for  this  is  felt  to  be  that  in  these  cases  the  singular  arcs  have  been 
very  closely  approached,  and  bearing  in  mind  that  the  integrations 
were  performed  backwards  in  time  the  trajectories  are  determined  by 
the  perturbations  off  the  singular  arc.  A  small  vertical  perturbation 
corresponds  to  trajectories  that  are  predominatly  in  a  vertical  plane, 
and  a  small  horizontal  perturbation  corresponds  to  trajectories  that 
are  predominately  in  a  horizontal  plane.  Thus  with  the  standard  model, 
gravity  is  sufficient  to  force  most  of  the  near  tail  chase  trajectories 
into  the  vertical  plane,  whereas  with  the  zero  gravity  model  the  snail 
terminal  parameters  and  integration  errors  dictate  the  direction  the 
trajectories  will  take. 

The  author  feels  that  if  closed-loop  control  laws  for  this  model 
could  be  found,  then  going  forward  in  time  the  trajectories  generated 
by  using  these  control  laws  with  the  standard  model  dynamics  would 
quite  closely  approximate  the  trajectories  produced  by  backward  inte- 
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cult  for  this  hypothesis  to  be  checked  by  the  use  of  a  hybrid  computer, 
or  for  a  limited  number  of  cases  by  using  a  gradient  technique  on  a 
digital  computer.  The  advantage  of  using  the  zero  gravity  fixed  velo¬ 
city  model  in  this  case  is  that  the  number  of  terminal  parameters  has 
been  reduced  by  two  from  the  case  of  the  standard  model,  so  that  the 
effort  involved  in  generating  an  open-loop  solution  forward  in  time 


is  considerably  reduced. 
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VI.  Pursuit-Evasion  Differential  Game-Spherical 
Acceleration  Vectograra  Model 

The  purpose  of  this  chapter  is  to  solve  a  differential  game  prob¬ 
lem  using  the  aircraft  dynamics  derived  in  Chapter  III  for  the  spheri¬ 
cal  acceleration  vectogran  model.  This  represents  the  best  model  for 
which  the  author  was  able  to  obtain  closed-loop  control  laws.  The 
derivation  of  the  closed-loop  control  laws  is  given,  representing  a 
"solution  in  the  small",  but  no  attempt  is  made  to  investigate  the 
various  surfaces  which  would  represent  a  "solution  in  the  large". 

The  reason  for  this  is  that  the  solution  of  this  differential  game 
is  not  an  end  in  itself,  but  merely  a  tool  with  which  to  attack  the 
solution  of  the  standard  model. 

Statement  of  the  Problem 

The  problem  is  to  determine  a  saddle  point  of 
t£ 

J(tf)  *  /  dt 

to 

subject  to 

*p”  VXP 


(6-1) 


(6-2) 


yp  -  vyp 

(6-3) 

^  "  VZP 

(6-4) 

^XP  “  pp£l 

(6-5) 

VTO  =  Fp£2 

(6-6) 
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VZP  -  PP£3 


(6-7) 


and 


XE  ’ 

VXE 

(6-8) 

yE  - 

VYE 

(6-9) 

• 

ZE  “ 

VZE 

(6-10) 

^XE 

(6-11) 

^YE 

-  F^2 

(6-12) 

Vze 

(6-13) 

where  Fp  and  FE  are  the  magnitudes  of  the  specific  excess  thrust  and 
are  constant,  and  and  m^  are  the  direction  cosines  of  the  pursuer's 
and  evader's  specific  excess  thrust  vectors  respectively,  and  represent 
the  two  players'  controls. 

The  controls  are  subject  to  the  constraints  real  and 


>  o  2 

+  *2  +  *3  “  1 


(6-14) 


and  ni£  real  and 


JBj  +  HI2  + 


(6-15) 


As  with  the  other  models,  the  terminal  surface  is  given  by 


7  =  (Xp-XE)|2  +  (yp-yE)|2  +  (Zp-ZE)|2  -  R2  e  0  (6-16) 


t«tf 


t»t. 


t*t« 
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and  the  subscripts  P  and  E  refer  to  the  pursuer  and  the  evader  respec¬ 
tively. 


Necessary  Conditions 

Rather  than  adjoin  the  control  constraints,  it  is  convenient  to 
make  the  substitutions 


t3  -  ±  V i  -  if  -  4 

and 

m$  *  ±V  l  -  n i  ~  a2 


(6-17) 


(6-18) 


With  these  substitutions ,  the  Hamiltonian,  H,  is  given  by 

H  =»  1  +  *XPVXP  4  *YPVYP  +  *ZPVZP  +  iVXPFPlI  +  ^VYP5* P*2 
i  AVZpFpV  1  '  1 1  ~  l2  +  *XEVXE  +  *YEVYE  +  *ZEVZE 
+  ^VXEPEm2  +  ^VYEpEb2  -  *VZEPE  ^  l~m  i  -  m*  (6-19) 


The  Hamiltonian  is  to  be  minimized  with  respect  to  the  pursuer’s  con¬ 
trols,  and  maximized  with  respect  to  the  evader's  controls. 

Applying  the  first  necessary  conditions 


or 


and 


— _  **  AyxpFp  +  AvzpPplj/  V  1  -  i*  -  l} 

3tj  4 

-  o 


A2  (1  -  1* 
VXP  1 


A2  % 
VZP 


2 

1 


(6-20) 


(6-21) 
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9H 

n2 


XvypPp  +  AVZP^P*2 


/V7T 


t?  - 1; 


or 


*VYP  *  1  “  £1  “  *1*  “  XVZP£2 


Therefore 


*?/*!  “  ^VXP/'VYP 


and  by  symmetry 


tVll  *  lVZP/XVYI> 


(6-22 i 

(6-23) 

(6-24) 

(6-25) 


Substitution  into  Eq  (6-14)  gives 

*1  “  ±  NntP^  ^  XVXP+  XVYP  +  *VZP  (6--c6) 


and  similar  expressions  may  be  obtained  for  i2,  i3.  Applying  the 
second  necessary  condition 


>.  0  (6-27) 

31? 


is  merely  checking  that  ij  minimizes  rather  than  maximizes  H.  This  is 
more  easily  established  by  substituting  for  ij ,  12  and  i3  in  H,  when 
it  is  obvious  that  to  minimize  H,  since  Fp  >  0, 


— “vxp'/"'/*vxp  +  avyp  +  avzp 


l2 - XVYP^"^  ^VXP  +  XVYP  +  XV 


VZP 


*3  ^VZP^^VXP  +  XVYP  +  *VZP 


(6-28) 

(6-29) 

(6-30) 
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A  similar  argument  may  be  used  to  show  that 


■>*  ‘  *  WV4T4T4 


(6-31) 


•* ' +  wv  ♦  >^E  ♦  xj2; 


(6-32) 


-3  “  -  WV  ♦  X3re  +  X3 


(6-33) 


The  costate  equations  are 


AXP  *  0 


(6-34.) 


Ayp  *  0 


(6-35) 


AZP  ”  0 


(6-35)  , 


AVXP  *  “*XP 


(6-37) 


AVYP  *  ~AYP 


(6-38) 


AVZP  *  “AZP 


(6-39) 


AXE  “  0 


avr  *  0 


AW  *  0 


*VXE  *  “XXE 


(6-40) 


(6-41) 


(6-42) 


(6-43) 
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XVYE  "  ~XYE 


(6-44) 


^VZE  *  "XJ 


(6-45) 


The  transversality  conditions  give 


H(tf)  =  H (t)  =0 


(6*46) 


XXP^fcf^  **  2V  ^Xp“XE^  1  *  -AyB(tf) 

t*txr 


(6-47) 


xyp{tf>  ■  2v  (yP“yE) I  •  “xYE<tf) 

t»tf 


(6-48) 


XZP  ftf )  “  2v  (zp“ze)  j  **  ~^2E  ftf) 


(6-49) 


Ayxpitf)  =  0  **  ^vXE  (^-f ^ 


(6-50) 


V(tf>  “  0  *  XVYE(tf) 


(6-51) 


XVZP(tf)  “  0  “  WV 


(6-52) 


Where  v  is  a  constant  which  must  satisfy  the  above  conditions. 


Problem  Solution 

Integration  of  the  costate  differential  equations  gives 


XXP  ^  **  ^xp  (^*f  J  3  2v  (Xp-XE)  | 

t=tf 


(6-53) 


*Yp{t)  =  XYP(tf)  *  2v  (yp’*yE)  5 


(6-54) 
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Agptt)  —  Agpttj)  —  2v  (Zp— zE)  |  (6—55) 

t-tf 


AyXP^^  **  (Xp— Xjj)  |  itf“t) 

t-tf 

(6-56) 

Ayypft)  *  2v  (yp-yE)  i  (tf-t) 

t=tf 

(6-57) 

Ay2p  (t)  *  2v  (Zp-ZE)  I  (tf — t) 

t-tf 

(6-58) 

*XE^  “  ^XE^f^  “  “^v  (xP“xeH 

t=tf 

(6-59) 

AyE(t)  »  AYE(t£)  -  -2v  (yp-yE) I 

t— tf 

(6-60) 

*ZE  &■)  -  Aze  (tf )  -  -2v  (Zp-ZE)  | 

t-tf 

(6-61) 

A^gCt)  -  -2v  (Xp-J^)!  (tf-t)  (6-62) 

t-tf 


AyygCt)  =  -2v  <yp-yE)|  (tf-t)  (6-63) 

t=tf 


\ze  (t)  *  ~2v  (zp"zE)  I  (tf-t)  (6-64) 

t=tf 


Substitution  of  the  costate  variables  into  the  minimax  controls 
gives 
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tj  -  -2V  (Xp-XE) 1  (tf-t)/ |2v  (tf-t)R| 

t»t{ 

*  (Xg-Xp) !  sqn  (v)/R 
t*tr 


(6-65) 


*2  -  (yE-yp) I  son  (v)/r 

t“t„ 


(6-66) 


*3  »  (zE-zp) J  sgn  (v)/R 
t-t* 


(6-67) 


and 


m?  -  -2v  (xp-xE)j  (t-c)/|2v  (tf-t)R| 
t*t£ 

*  (xE-Xp) I  sgn  (v)/R 
t*t. 


(6-68) 


®2  “  (yE“yP} I  sgn 


t=t. 


(6-69) 


®3  *  1  sgn  (v)/R 


t-t« 


(6-70) 


It  is  interesting  to  note  that  the  pursuer's  and  the  evader's  controls 
are  identical  and  constant.  Further,  the  ratio  of  the  components  of 
the  controls  is  the  same  as  the  ratio  of  the  corresponding  relative 
coordinates  at  termination. 

Now  using  the  fact  that  H(t£)  »  0  gives 


H(t£)  s  1  +  [2v  (xp— xE)  ]  | 


t»t. 


♦  I2V  (yP-yE)  (Vyp-vyE)]  j  +  [2v  (Zp-ZE)  (v^-v^)  ]  ( 


t«t. 


t»t. 


(6-71) 
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2v  *  -l/{  (xE-xP>  (Vjjg-Vjjp)  +  (yE-yp)  (v^-Vyp) 
♦  (zE-zp) (Vgg-Vgp) } | 


(6-72) 


Now  if  r  is  defined  as  a  vector  from  the  pursuer  to  the  evader,  and 

A  A  * 

i,  j,  k  are  unit  vectors  in  the  x,  y,  z-directions 


r  »  (xE-Xp)  i  +  (yE-yp)  j  +  (zE  -zp)  k 


(6-73) 


r  -  (VxE-Vjjp)  i  +  (Vyg-Vyp)  j  +  (Vzg-Vgp)  k 


(6-74) 


and  from  basic  dynamics  (differeniate  r*r  *»  r2) 


rr  «  r-r 


(6-75) 


so  that 


r  (tf)  »  {  (VjjE**Vxp)  (xE-Xp)  +  (VyE-Vyp)  (yE-yp) 

+  ^ZB“V2P^  (zE~Zp) }  J  /R 

t«t£ 


(6-76) 


However,  for  capture  to  occur  it  is  necessary  that  r(tf)  <  0  and  so 


{ (xB-Xp)  +  (Vyg-Vyp) (yE-/p)  +  (Vgg-Vgp) (z£-Zp) } |  <  0 

t=txr 


and  hence  from  Eq  (6-72) 


(6-77) 


v  >  0 


16-S) 


The  minimax  controls  are  thus 


(xE— xp) |  /R 

t=tf 


(6-79) 
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(6-80) 


n3 


(ZE"ZP^  I 


t«t< 


(6-81) 


Using  these  controls,  the  state  equations  jure  integrated  backwards 
in  time  from  tf,  which  gives 


Vxp(t)  —  Vjjp  (tj)  *  E  (xE-xp)  |  (t— tf) 


(6-82) 


t*t. 


Vyp(t)  -  Vyp(tf)  *  5-  (yE-yp)|  (t-tf) 


(6-83) 


t«t- 


Vj5p(t)  -  Vjjp  (tf )  *  ^  (ZE-ZP)  |  (t-tf) 


(6-34) 


t=t. 


xp(t)  -  Xp(tf)  »  ~  (xE-xp)  |  (t-tf)2  +  vxp(tf)  (t~tf) 


trt- 


(6-85) 


yp(t)  -  yp(tf)  *  2R  (yE'yP) I  (t-tf)2  +  Vypttf) (t-tf) 

t=t- 


(6-86) 


zp(t)  -  zp(tf)  -  ^  (ZE-Zp) |  (t-tf)2  +  V2p(tf) (t-tf) 

t=t* 


(6-87) 


and  sinilar  expressions  for  the  evader.  Since  this  is  a  perfect  in¬ 
formation  game  the  values  of  the  state  variables  are  known  at  time  t, 
and  the  aim  is  to  el  iminate  their  values  at  tf.  Substitution  of  Eq 
(6-82)  into  Eq  (6-85)  yields 
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F, 


Xp(t)  -  Xp(tf)  -  (Xg-Xp)!  (t-tf)2  +  v^ft)  (t-tf) 


t**t« 


-  ~  (xE-xp) I  (t-tf )2 

K  . .  .  *■ 


t=t< 


*=  vxp(t)  (t-tf)  -  ~  (XE-Xp)|  (t-t,)2 
XK  t=tf 


(6-88) 


and  similarly  for  the  evader 


xE(t)  -  xE(tf)  =  vxE<t) (t-tf)  -  ~  (xE-xp)|  (t-tf)2  (6-89) 


2R 


t=t« 


Subtracting  Eq  (6-89)  from  Eq  (6-88) 


(xE-xp)|^  (I  +  (tf-t)2  (Fp-Fe)/2R)  =  (xE-xp)  +  (VXE-Vxp)  (tf-t) 


(6-90) 


and  similarly 


<yE-'’p>  ]  .  I1  +  (tf-t)*  <VFEI/2R1  *  (yE-yp>  +  (VYE-Vyp» 


t=t. 


(6-91) 


(ZE~ZP)|=fc  11  +  (tf't)2  (Fp-FE)/2R]  =  (zE-zp)  +  (V^-V^)  (tf-t) 


(6-92) 


Squaring  and  adding  Eqs  (6-90),  (6-91),  (6-92) 


R2  (1  +  (tf-t)2  (Fp-FE)/2R]2  =  l(xE-xp)  +  (VXE-Vxp)(tf-t))2 

+  ( (vK~yp)  +  (Vys-Vyp) (tf-t))2  +  I(zE-zp)  >  (V2E-Vzp)/(tf-t) 


(6-93) 


or 
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rt)‘*  +  (tf-t)2  [  (Fp-Fp)  R  "  {VXn-Vxp)2  -  (V^-V^)2 


yp 


~  (,,r2E**vzp^2^  ~2  (t£-t)  f  (xE-xp>  ^xe~vxp>  +  Cyg-yp)  (Vyg-Vyp) 
+  (zE-zp) CvZE-v^p) ]  +  R2  -  (xE-xp)2  -  <yE-yP)2  -(zE-zp) 2  «  o 


(6-94) 


This  nay  be  more  convenient 2 y  expressed  using  the  notation  of  Eqs  (6-73), 
(6-74)  and  (6-75)  as 


(tf-t) 


*  (fp~fe)2  . 


*  (tf-t)2  [ (Fp-Fg)  R  -  I‘T} 


-2  (tf-t)rr  +  (R2-r2)  =  0 


(6-95) 


This  is  a  quartic  which  may  be  solved  at  any  time  t  to  give  (tf-t) 
which  is  the  only  unknown  in  the  equation.  This  value  of  (tf-t) , 
normally  the  smallest  positive  root  of  the  quartic,  may  then  be  used 
to  evaluate  the  controls  at  time  t,  which ,  using  Eqs  (6-90),  (6-91) 
and  (6-92)  are 


((Xjj-Xp)  +  (VXE'V)Cp)  (tf-t) ]/[R  +  \  (Fp-FE)  (tf-t)2) 


(6-96) 


-  is*  -  C(yE-yP)  +  (VyE-Vyp)  ltf-t)]/CR  +  %  (Fp-FE)  (tf-t)2] 


(6-97) 


*3  *  ”3 


C(ZE-Zp)  +  (VZE-Vzp)(tf-t))/[R  +  %  (Fp-FE) (tf-t)2] 


(6-98) 


Thus  open-loop  controls  are  found  by  solving  for  (tf-t)  from  Eq  (6-95) 
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at  some  initial  time  tfl,  evaluating  l*,  ra*,  m*  and  n*  from 

Eqs  (6-96) ,  (6-97)  and  (6-98)  and  keeping  then  constant.  Since  con¬ 
tinuously  updafcahis  open-loop  solutions  are  equivalent  to  closed-loop 
solutions,  closed-loco  controls  are  found  by  solving  for  (tf-t)  con¬ 
tinuously  and  using  this  value  to  determine  the  direction  cosines  at 
each  instant. 

Examination  of  Solutions 

In  order  to  compare  the  ninimax  solutions  for  this  model  with  those 
of  the  standard  model,  runs  were  made  backwards  in  time  for  the  same 
terminal  states  as  were  used  for  the  ooen-loop  standard  model  solutions. 
The  magnitude  of  the  specific  excess  thrust  for  each  player  was  made 
equal  to  that  player's  maximum  specific  lift  force  at  termination,  so 
that 

Fp  «*  kDP  (Vp{tf)J2  CLpnax  *  kDpS2  CJjPinax  (6-99) 

and 

FE  18  kDE  *VE(tf)l2  CLEnax  *  kDES5  CLEM1X  (6-100) 


Some  typical  runs  sure  shown  in  Appendix  C.  At  first  sight  it 
would  appear  that  there  is  little  similarity  between  the  solution  to 
the  spherical  vectogram  model  and  the  solutions  to  the  standard  model. 
However,  subject  to  two  restrictions  the  solutions  to  the  two  models 
show  enough  similarity  to  indicate  that  the  model  should  be  of  use. 

The  first  restriction  is  that  gravity  has  been  ignored,  so  that  as 
with  the  zero  gravity,  fixed  velocity  model  solutions,  the  trajectories 
should  be  considered  as  being  displaced  a  distance  %  g (tf-t) 2  verti- 
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cally  when  viewed  in  real  space.  The  second  restriction  is  that  there 
is  no  constraint  to  stop  the  player's  velocities  dropping  to  unrealis¬ 
tically  low  values.  This  is  most  obvious  in  Fig.  5  where  both  players 
fly  out  and  back  along  the  same  line  in  space,  and  actually  come  to 
rest  at  one  point. 

Notwithstanding  the  above  restrictions,  the  solutions  to  this 
spherical  vectogram  model  display  to  a  significant  degree  some  of  the 
general  characteristics  of  the  standard  solutions.  Since  in  addition 
this  is  the  only  model  for  which  closed-loop  control  laws  could  be 
found  and  which  did  display  any  similarity  at  all  with  the  standard 
model,  the  solution  to  this  spherical  vectogram  modr?l  is  used  as  a 
basis  for  formulating  near-optimal  controls  for  the  standard  model. 

Finally,  it  is  interesting  to  note  that  the  above  solution  not 
only  extends  some  previous  two-dimensional  work  (Ref  5:1463)  into 
three-dimensions,  but  also  provides  equivalent  closed-loop  controls 
which  were  not  obtained  for  the  two-dimensional  study. 
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VII.  Development  of  Pseudo  Closed-Loop  Minimax  Controls 

for  the  Standard  Model 


The  purpose  of  this  chapter  is  to  derive  an  approximation  to  the 
closed-loop  control  laws  for  the  standard  model  based  on  the  solution 
obtained  in  Chapter  VI  to  the  spherical  acceleration  vectogram  model. 


Best  Control  Approximation 

The  most  successful  method  the  author  has  found  is  to  solve  Eos 
(6-95),  (6-96),  (6-97)  and  (6-98)  at  every  instant  in  time.  This 
yields  the  controls  ,  t2,  t3,  mj ,  m2,  m3  that  would  be  optimal  if 

the  dynamics  were  in  fact  those  of  the  spherical  acceleration  vecto- 
grara  model.  Denoting  either  player's  specific  excess  force  as  a 
vector  F,  one  may  think  of  its  component  normal  to  V  as  being  equiva¬ 
lent  to  the  specific  lift  gL/W.  Thus  p  is  chosen  so  that 


L*  (F  x  V)  *  0  (7-1) 

and  CL  is  chosen  so  that 


Substituting  the  values  of  L,  P,  and  V  into  Eq  (7-1),  gives  for 
the  pursuer 

(-cos  wp  sin  Yp  cos  xp  -  sin  pp  sin  xp)  (l^vzp~t3Vyp) 

+  (-cos  jip  sin  yp  sin  xP  +  sin  pp  cos  xP)  (~llvzp  *  £3VXP) 
+  (cos  yp  cos  Yp)  <1ivyp-12vxpJ  “  0  (7-3) 


or  more  simply 
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tan  Up  -  (*2Vzp*‘13vyp>  sin  yp  cos  Xp  ♦  {^xp-^zp*  sin  7p  sin  Xp 


-  (ilVyp-tzVxp)  COS  Y] 

-  U2VZP“*3VYP)  sin  Xi 


and  similarly  for  the  evader 


■]/[ 


(t3VXP‘tlVZPJ  003  Xp 


(7-4) 


tan  u 


E  *  (ra2VZE-m3VYE>  Sin  rE  COS  XE  +  (a3VXE^VZE}  sin  YE  Sin  XE 


-  (n1VyE-n2VXE)  cos  y£ 

-  (p,2VZE-r!3VYE)  sin  XE 


]/[ 


^n3VXE“nlV22^  cos  Xt 


If  F  is  chosen  so  that  at  any  instant 


F  »  kr,  V*  C, 


D  v  " W 


then  Eq  (7-2)  becomes,  for  the  pursuer. 


(7-5) 


(7-6) 


(11VXP  +  £2VYP  +  i3VZP)2/VP  +  {CLp/CLPnvax)  2  =  1 


(7-7) 


CLP  3  1  CtP^  I1 


-  UjVjjp  +  £2Vyp  + 


Similarly,  for  the  evader. 


CLE  *  4 


CLEnax  ^  ~  ^mlVXE  +  n2VYE  +  d3VZE^2/Ve^ 


(7-8) 


(7-9) 


The  signs  of  Cjj,  and  CTy  axe  chosen  so  as  to  make  L  act  in  the  same 

direction  along  the  three  axes  as  F.  Thus  for  the  pursuer’s  x-component, 
it  is  necessary  that  £i  and  Cj^p  {-cos  up  sin  yp  cos  Yp  -  sin  up  sin  xp) 


are  both  positive  or  both  negative.  Similarly  for  the  evader’s 
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x-component .  it  is  necessary  that  r»»  and  {  “CCS  M£  SXjl  fg  COS  X  £  " 
sin  i>£  sin  xE)  have  the  same  sign. 

Using  these  pseudo  controls ,  the  standard  dynamics  may  be  inte¬ 
grated  forwards  a  small  time  At.  The  pseudo  controls  cure  then  evalua¬ 
ted  again  and  the  process  repeated  until  such  time  as  capture  occurs 
or  is  obviously  not  going  to. 

Calcomp  plots  of  fo'ir  such  runs  forward  in  time  from  the  states 
reached  after  10  seconds  backward  integration  of  minimax  solutions  to 
the  standard  model  are  shown  in  Figs.  9,  16,  23  and  30.  The  Value  of 
the  game  for  each  of  these  runs  should  be  10.0  secs.  The  actual 
Values  obtained  were 

Run  1  Value  -  10.0  secs 

Run  2  Value  **  6.0  secs 

Run  3  Value  =  10.0  secs 

Run  4  Value  **  10.1  secs 

Considering  Runs  1  and  4  first,  the  agreement  between  the  approxi¬ 
mate  forward  solutions  and  the  open-loop  backward  solutions  is  remark¬ 
ably  good.  The  two  runs  are  very  different  in  nature  and  yet  in  both 
cases  the  approximate  trajectories  follow  very  closely  the  open-loop 
trajectories.  Furthermore,  the  Value  for  both  approximate  runs  is  very 
close  to  the  standard  Value  of  10.0  secs.  The  roots  of  (tf-t)  evalu¬ 
ated  at  each  instant  for  the  approximate  model  are  generally  rather 
lower  than  the  true  time  to  capture  (typically  6  secs  instead  of  10 
secs),  so  they  cannot  be  used  as  an  instantaneous  estimate  of  the  Value 
of  a  game.  However,  the  controls  based  on  these  roots  closely  approxi¬ 
mate  the  open-loop  controls. 
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At  first  sight  the  results  in  Run  3  appear  as  good  as  those  for 
Runs  1  and  4,  but  there  is  one  qualification-.  For  all  practical  pur¬ 
poses,  the  pursuer  may  be  assumed  to  capture  the  evader  at  10.0  secs 
after  starting,  but  he  is  in  fact  still  5014  ft  from  the  evader 
(R  *  5000  ft),  and  starts  to  move  away  again  after  this  time  of  closest 
approach.  This  moving  away  again  is  first  forecast  from  the  solution 
of  Eq  (6-95)  for  (tf-t).  At  9.0  secs  after  to  the  smallest  positive 
root  of  the  quartic  takes  a  discontinuous  jump  from  1.11  secs  to 
104.20  secs.  This  corresponds  to  a  change  from  the  quartic  having 
three  real  positive  roots  to  its  having  only  one.  Examination  of 
Eq  (6-95)  shows  that  it  always  has  at  least  one  real  positive  root, 
but  whether  or  not  it  has  three  depends  on  the  sign  and  magnitude  of 
the  coefficients  of  (tf-t) 2  and  (tf-t) . 

In  Run  2,  the  general  form  of  the  approximate  and  the  open-loop 
trajectories  is  the  same.  However,  capture  occurs  after  only  6.0  secs. 
The  reason  for  this  is  that  at  the  start  of  the  game  in  the  approximate 
forward  solution,  the  evader  thinks  he  can  escape  on  the  first  pass 
since  the  value  obtained  for  (tf-t)  is  46.89  secs.  The  evader  thus 
does  not  turn  quite  sharply  enough  (Cr.n  »  0.70  instead  of  Ct.k  **  0.75) 
and  so  flies  into  the  pursuer.  Then  at  0.6  secs  after  to,  the  evader 
finds  that  the  value  of  (tf-t)  jumps  from  48.04  secs  to  6.83  secs,  and 
capture  is  inevitable. 

It  should  be  stressed  that  the  four  runs  presented  and  compared 
above  were  not  chosen  so  as  to  show  the  approximate  controls  to  any 
particular  advantage  or  disadvantage .  The  runs  were  chosen  so  as  to 
be  typical  of  different  types  of  open-loop  solutions,  or  to  show  the 
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effect  of  velocity  variations  on  the  trajectories. 

It  thus  seems  that  these  pseudo  optimal  controls  are  a  good  approxi¬ 
mation  except  where  the  solution  of  E a  {6-95)  yields  only  one  real  posi¬ 
tive  root.  A  deeper  investigation  of  this  equation  and  an  attempt  at 
a  solution  of  the  game  of  kind  for  the  spherical  acceleration  vectogram 
model  might  yield  a  better  understanding  of  the  precise  conditions  under 
which  the  pseudo  control  approximation  is  valid. 

Alternative  Control  Approximations 

In  an  attempt  to  improve  the  approximation  of  the  above  model,  two 
variations  were  tried.  However,  the  effect  of  both  variations  was 
found  to  be  generally  detrimental. 

The  first  variation  tried  was  to  use  the  values  of  y  as  calculated 
before,  but  to  use  the  results  of  the  zero  gravity,  fixed  velocity 
model  in  calculating  Cj,.  The  lift  coefficient  was  then  set  to  +ciTOax» 

0,  or  -Cr^  .  The  result  of  this  was  to  make  the  trajectories  in  space 

for  Runs  1  and  4  look  slightly  better,  but  change  the  Values  obtained 
to  10.8  and  8.7  secs  respectively.  The  change  in  the  Values  was  due 
to  the  slower  velocities  because  of  the  greater  induced  drag.  In  Runs 
2  and  3  capture  failed  to  occur. 

The  second  variation  tried  was  to  modify  Fp  and  FE  so  as  to  give 
some  influence  to  the  differences  in  potential  energy.  This  was  ef¬ 
fected  by  setting 

FP  *  kDP  CLPnax  lVf  ~  9  (zE'zP>l  (7-10) 

and 

FE  *  kDE  CLEraax  *VE  +  -  (zE-zp)J 


(7-11) 
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This  is  equivalent  to  basing  F  on  the  total  energy  rather  than  just  the 
kinetic  energy.  Using  this  model  the  Values  obtained  for  Runs  1  and  4 
were  10.0  and  7.6  secs  respectively.  Again  capture  failed  to  occur  in 
Runs  2  and  3. 

Suggested  Algorithm  to  Determine  a  Player's  Controls  During  an  Actual  ‘ 
Encounter 

It  seems  that  the  pseudo  closed-loop  controls  developed  in  Eqs 
(7-4) ,  (7-5),  (7-8)  and  (7-9)  are  a  good  approximation  to  the  optimal 
closed-loop  controls  in  most  circumstances. 

The  following  algorithm,  which  could  be  used  by  the  pursuer  in  an' 
encounter,  seems  reasonable,  but  has  not  yet  been  tested: 

1.  Using  energy  maneuverability  considerations  fly  in  such 
a  way  as  to  arrive  in  the  general  vicinity  of  the  evader 
with  as  large  a  velocity  as  possible. 

2.  Once  positioned,  set  Fp  -  kDP  v|  and  FE  »  kDE  v|. 

3.  Solve  Eq  (6-95)  for  the  smallest  positive  root  of  (tf-t). 

4.  Use  this  value  of  (tf-t)  in  Eqs  (6-96),  (6-97)  and  (6-98) 
to  find  li,  •  *3* 

5.  Evaluate  C^p  and  np  using  Eqs  (7-8)  and  (7-4) . 

6.  Use  these  controls  for  a  short  time  interval,  and  then 
return  to  Step  2  to  evaluate  new  controls. 

An  algorithm  that  the  evader  could  use  might  be: 

1.  Using  energy  maneuverability  considerations  fly  in  such 
a  way  as  to  avoid  for  as  long  as  possible  arriving  in  the 
general  vicinity  of  the  pursuer  with  a  velocity  disadvan¬ 
tage. 
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2.  As  soon  as  Step  1  fails*  or  if  it  becomes  obvious  that  the 
pursuer  has  started  some  form  of  terminal  guidance*  set 

FP  "  kDP  CLPmax  Vl  and  FE  *  kDE  CLEmax  VE* 

3.  Solve  Eq  (6-95)  for  the  smallest  positive  root  of  (tf-t) . 

4.  Use  this  value  of  (tf~t)  in  Eqs  (6-96),  (6-97)  and  (6-98) 
to  find  C|*  m2*  m3. 

5.  Evaluate  CTJ.  and  jiE  using  Eqs  (7-9)  and  (7-5). 

6.  Use  these  controls  for  a  short  time  interval,  and  then 
return  to  Step  2  to  evaluate  new  controls. 

A  knowledge  of  a  solution  to  the  game  of  kind  (Ref  3:8)  as  well 
as  solutions  to  the  game  of  degree  would  also  provide  both  players 
with  valuable  information  about  regions  in  space  that  they  should 
avoid  or  aim  for  in  their  preliminary  maneuvering.  Limitations  of 
both  space  and  time  have  precluded  any  investigation  of  the  game  of 
kind  as  part  of  this  study. 
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VIII.  Conclusions  and  Recommendations 


Conclusions 

A  realistic  two  aircraft  combat  encounter  has  been  posed  as  a  zero 
sum,  perfect  information  differential  game.  In  analyzing  the  problem, 
three  models  of  the  aircraft  dynamics  have  been  used.  These  three 
models  were  the  standard  model;  the  zero  gravity,  fixed  velocity  model; 
and  the  spherical  acceleration  vectogram  model. 

For  the  standard  model,  the  author  obtained  open-loop  solutions, 
but  was  unable  to  find  closed-loop  control  laws.  In  order  to  investi¬ 
gate  the  nature  of  the  open-loop  solutions,  a  number  of  them  were 
generated  numerically  and  the  trajectories  plotted.  The  controls  used 
in  this  model  were  the  lift  coefficient  and  the  bank  angle.  The  ex¬ 
pressions  for  these  controls  contained  the  current  values  of  both  the 
state  and  costate  variables.  Examination  of  a  number  of  numerical 
solutions  showed  that  the  value  of  each  player's  lift  coefficient 
would  remain  at  its  maximum  (either  positive  or  negative)  unless  a 
direct  tail-chase  situation  was  being  approached  in  which  case  the 
coefficient  would  reduce  smoothly  and  monotonically  towards  zero.  The 
author  was  unable  to  characterize  or  detect  any  pattern  in  the  behavior 
of  the  bank  angle.  The  only  real  conclusion  formed  was  that  two-dimen¬ 
sional  planar  assumptions  were  completely  invalid  because  most  trajec¬ 
tories  observed  showed  violent  out  of  plane  maneuvers. 

For  the  zero  gravity,  fixed  velocity  model,  the  author  again  ob¬ 
tained  open-loop  solutions.  As  with  the  standard  model,  closed-loop 
control  laws  could  not  be  found;  but  in  this  case  it  was  possible  to 
eliminate  t5"e  costate  variables  from  the  solutions  and  express  the 
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controls  as  functions  of  the  current  and  terminal  values  of  the  state 
variables  alone.  This  provides  a  considerable  simplification  in  the 
solution  of  the  two  point  boundary  value  problem.  Open-loop  solutions 
for  this  model  were  generated  numerically  and  plotted  for  comparison 
with  the  standard  model.  Subject  to  the  limitations  of  the  vertical 
displacement  in  space  because  of  the  absence  of  gravity,  and  the  sensi¬ 
tivity  of  solutions  produced  by  backward  integration  to  initial  small 
disturbances,  the  solutions  to  this  model  showed  good  agreement  with 
those  obtained  for  the  standard  model. 

For  the  spherical  acceleration  vectogram  model,  the  author  was 
able  to  obtain  closed-loop  control  laws.  The  controls  used  in  this 
model  were,  however,  no  longer  the  lift  coefficient  and  the  bank  angle, 
but  the  direction  cosines  of  a  specific  excess  thrust  instead.  For 
purposes  of  comparison  with  the  standard  model,  a  number  of  open-loop 
solutions  for  this  model  were  generated  numerically  and  the  trajec¬ 
tories  plotted.  The  solutions  were  subject  to  the  same  limitations  as 
were  those  for  the  zero  gravity,  fixed  velocity  model,  and  in  addition 
had  the  more  serious  limitation  that  the  aircraft  velocities  could  drop 
to  unrealistically  low  values.  This  meant  that  impossibly  sharp  turns 
could  be  executed.  Notwithstanding  these  limitations,  this  model  is 
the  closest  dynamic  representation  for  which  closed-loop  solutions 
have  been  found.  Further,  the  solutions  show  sufficient  similarity  to 
the  standard  model  solutions  to  indicate  that  the  model  should  be  of 
considerable  value  in  formulating  approximate  closed-loop  controls  for 
the  standard  model. 

Finally,  approximate  closed-loop  controls  for  the  standard  model 
were  produced  from  the  spherical  acceleration  vectogram  model  solution. 
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A  number  of  methods  of  finding  equivalent  controls  were  tried,  and 
each  method  was  tested  by  integrating  the  standard  dynamics  forward  in 
time  using  these  approximate  controls.  Ate  integrations  were  started 
from  the  states  reached  by  backward  integration  of  open-loop  solutions 
to  the  standard  model.  Thus  the  accuracy  of  the  approximation  could 
be  determined  from  the  closeness  with  which  the  pseudo  optimal  trajec¬ 
tories  followed  the  true  optimal  trajectories.  The  most  effective  of 
the  approximations  gave  good  agreement  under  almost  all  the  conditions 
tested.  However,  it  is  felt  that  caution  should  be  exercised  when 
considering  problems  where  there  is  a  large  altitude  difference  be¬ 
tween  the  players,  since  the  model  makes  no  allowance  for  potential 
energy  advantages.  Apart  from  this  restriction,  the  author  feels 
that  the  approximate  controls  given  in  Chapter  VII  could  form  the 
basis  for  some  very  good  approximations  to  optimal  controls  for  use 
in  dogfight  situations. 

Recommendations 

The  author's  main  recommendation  is  that  the  study  of  this  problem 
should  continue.  This  thesis  has  laid  the  groundwork  for  obtaining 
practical  approximate  solutions  to  the  three-dimensional  pursuit-eva¬ 
sion  problem,  and  has  shown  that  such  solutions  do  exist. 

The  author  feels  that  two  further  approaches  to  the  problem  should 
be  tried.  These  are: 

1.  The  use  of  a  hybrid  computer  to  investigate  the  possibility 
of  rapidly  obtaining  open-loop  solutions  to  either  the 
standard  or  the  zero  gravity,  fixed  velocity  model.  If 
these  solutions  could  be  obtained  rapidly  enough,  then  con- 
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tlaasj-isly  vpdated  (or  equivalent  closed-loop)  solutions 

night  be  practicable. 

2.  An  investigation  of  the  game  of  kind  for  the  spherical 
vectogram  model,  with  particular  attention  to  the  number 
and  form  of  solutions  obtained  from  E q  (6-95) . 
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Appendix  A 

The  Use  of  One  Player  Optimization  Techniques  in  Certain 

Differential  Games 

In  both  Chapters  IV  and  V  use  was  made  of  the  fact  that  that  part 
of  the  Hamiltonian  containing  only  the  pursuer's  (evader's)  state 
variables  and  controls  remains  constant,  the  circumstances  under  which 
this  is  true  and  a  proof  of  the  theorem  are  given  in  this  appendix. 

One  of  the  difficulties  in  obtaining  solutions  to  realistic  dif¬ 
ferential  games  is  in  integrating  the  costate  differential  equations. 
Hence,  it  is  felt  that  the  theorem  given  below  may  be  of  great  use  in 
that  it  avoids  the  need  for  integration  of  at  least  one  of  the  costate 
equations. 

Theorem 

Consider  a  zero-sum  perfect  information  differential  game  with  a 
payoff  of  time  to  capture,  or  a  function  of  the  states  at  termination, 
or  a  combination  of  both.  If  the  state  equations  can  be  written  so 
thr.t  the  pursuer's  (evader's)  state  variables  are  independent  of  both 
the  evader's  (pursuer's)  state  variables  and  controls;  time  does  not 
appear  explicitly  in  the  Hamiltonian;  and  all  the  control  constraints 
are  time  invariant,  then  for  solutions  in  the  small  that  part  of  the 
Hamiltonian  that  consists  of  the  terms  containing  only  the  pursuer's 
(evader's)  state  and  costate  variables,  and  the  pursuer's  (evader's) 
controls  remains  constant  along  minimax  trajectories. 

Proof 

If  the  pursuer's  evader's  state  equations  are  independent,  it  is 
possible  to  express  the  dynamics  of  a  differential  game  as 
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•  _ 

Xp  ■  f p  (Xp,U,t) 
*E  “  ?E  (*E'7't} 


The  theorem  is  restricted  to  payoffs  of  the  form 


J  »  ♦  <x(tf),tf)  *  /  C  dt 


where  C  is  constant. 

The  Hamiltonian  is  then 

T  _  _3>  _  T 

H  -  A  f+C«Apf  +  Ag  f  C 


(A-l) 

(A-2) 


CA-3) 


(A-4) 


Denote  that  peart  of  the  Hamiltonian  that  consists  of  the  terms  con¬ 
taining  only  the  pursuer's  state  and  costate  variables  and  the  pur¬ 
suer's  controls  as  Hp.  Then 


_T  _  _T  _ 
A  f  «  f  A 
P  P  P  P 


(A-5) 


and 


dHP  _  V  d>p .  3hp  ,  3hp  a? ,  »%■ 

dt  3Ap  dt  3xp  dt  3u  dt  3t  dt 


Now  if  t  does  not  appear  explicitly  in  H,  it  cannot  appear  explicitly 


in  Hp,  so 

3HP 

— -  *  0  (A-7) 

3t 


Since  the  Hamiltonian  is  being  evaluated  along  a  minimax  trajectory 
described  in  the  small,  either  the  ith  component  of  the  control  vector 
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is  internal,  in  which  case 


3H 

3^-3^“  0 

or  the  control  is  on  the  limit,  which  is  time  invariant,  and  so 

f^.O 

dt 


(A-8) 


(A-9) 


Using  B qs  (A-8),  (A-9)  on  each  component  of  the  control  vector  gives 

pL-  .  H  «  0  (A-10) 

3n  dt 


Now  the  necessary  conditions  give 


ip 

-  i  -  -  !$■«  - 

aBp " 
3xp 

*E 

*  « 

3He 

(A-ll) 


Substitution  of  Eqs  (A-7) ,  (A-10)  and  (A-Il'  into  Eq  (A-6)  gives 

dHp  aBpT  3  Bp  aBpT  dxp 

dt  aT  3xp  3xp  *  dt 


-jpp  dRp  3Rp  _ 

«  -  f  I  .  — ~  +  — *  .  f  tz  o 
p  3xp  3xp  p 


and  so 


Bp  =  constant 

An  exactly  similar  argument  may  be  used  to  show  that 
He  *  constant 


(A-12) 


(A-13) 


(A-14) 
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ject  to  the  restrictions  specified  in  the  theorem,  Hp  and  RE  remain 


constant 
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Appendix  B 

Some  Unsuccessful  Approximations  to  Closed-Loop  Minimax 
Controls  for  the  Standard  Model 


There  are  two  basic  approaches  which  may  be  taken  in  attempting  to 
find  approximate  closed-loop  controls  for  a  differential  game  which 
would  otherwise  be  insoluble.  The  first  and  most  usual  of  these  methods 
is  that  of  using  an  approximate  model  of  the  true  dynamics,  and  solving 
the  differential  game  based  on  this  model.  This  was  done  in  the  main 
body  of  this  report.  The  other  method  has  the  possibility  of  a  truer 
representation  but  is  less  certain  of  success ,  and  is  highly  dependent 
on  intuition  and  luck.  This  method  consists  of  somehow  formulating  a 
proposed  control  law  and  then  comparing  it  with  numerically  evaluated 
open-loop  solutions  of  the  standard  model. 

In  his  study  of  possible  approaches  to  the  solution  of  the  standard 
model,  the  author  tried  a  number  of  these  artifically  generated  control 
laws.  Although  some  of  them  could  be  fitted  closely  to  any  one  tra¬ 
jectory,  any  significant  change  in  the  terminal  conditions  meant  the 
fit  could  no  longer  be  considered  satisfactory.  All  but  two  of  the 
artificial  control  laws  tried  were  generated  by  constructing  a  poly¬ 
nomial  from  terms  that  it  would  appear  to  be  reasonable  for  the  partic¬ 
ular  control  being  investigated  to  depend  on.  The  constants  in  the 
polynomial  were  generated  using  a  least  squares  fit  to  a  particular 
open-loop  solution.  This  approximate  closed-loop  control  was  then  com¬ 
pared  with  the  controls  generated  by  other  open-loop  solutions.  The 
reason  for  using  a  polynomial  was  that  in  the  absence  of  any  definite 
reason  for  using  other  functions,  it  was  the  most  convenient  form  to 
use  in  a  least  squares  fit,  and  most  of  the  common  trigonometric  and 
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exponential  functions  can  be  approximated  by  sufficient  terms  of  a 
polynomial . 

One  of  the  exceptions  to  the  above  method  of  formulating  trial 
controls  was  an  analytically  derived  control  law  based  on  the  principle 
that  the  pursuer  (evader)  would  want  to  use  those  controls  that  would 
tend  at  every  instant  to  minimize  (maximize)  the  rate  of  rltange  of  the 
distance  between  the  two  players.  The  other  exception  was  to  consider 
that  at  each  instant  in  time  the  game  was  about  to  terminate,  and 
evaluate  the  controls  as  though  on  a  terminal  surface. 

Before  listing  the  trial  controls  that  the  author  tried,  it  is 
convenient  to  define  the  following  variables: 

£  is  a  unit  vector  in  the  z -direction 
r  is  the  radius  vector  from  P  to  E 
r  is  the  magnitude  of  r 
r  is  the  rate  of  change  of  r 
Vp  is  the  pursuer's  velocity  vector 
vrel  is  the  velocity  of  E  relative  to  P 
rn  is  the  component  of  r  normal  to  Vp 

Vn  is  the  component  of  Vrej^  normal  to  Vp 
g0  is  a  reference  gravitational  acceleration. 

Since  CL  and  y  are  both  non-dimensional,  it  seemed  logical  to  non- 
dimensional  ize  those  terms  being  used  in  the  various  polynomial  fits. 

The  polynomials  that  were  tried  in  an  attempt  to  synthesize  CLP 
were  fitted  to  C^p  rather  them  C^p* .  The  trial  polynomials  were 


1, 


sgn  (Zjj— zp) 


(B-l) 
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9  /«..  >  k. 

--  _liP  "1 


3.  *  Aj 


90  COS  yp 


g0  cos  Yp 


kn!  K! 


_ _  /*.  »  % 

awn  '6E”4p^ 


knl 


+  A. 


rn*vn 


+  a,.  Jy."  * r"1 


rv- 


4*  lcLpl  **  A1  “ 


!rn! 


+  hr 


2  r  3  rVp 

sgn  (z^-Zp  -  r  sin  Yp) 

|V„  *  *nl 


rn*V„ 


rvp  +  A3  rVj 


«.  Li.  Irnl  .  rn*vn  lvn  x  rnl 

5*  lcLP  I  A1  — —  +  A2  — - +  A3 


KVr 


RV- 


(3-2) 


(B-3) 


(B-4) 


(B-5) 


where  the  A^  are  arbitrary  constants.  The  fit  to  the  magnitude  of 
Cjj>  could  be  kept  within  about  10%  with  all  of  the  above  provided  the 
terminal  conditions  were  not  varied  too  much.  The  greatest  difficulty 
encountered  was  in  trying  to  natch  the  switching  function  which  deter¬ 
mines  the  sign  of  Cjjo.  None  of  the  switching  functions  used  in  the 
above  controls  was  even  close  to  determining  the  correct  sign  on  C^p. 

The  polynomials  that  were  used  in  a  trial  fit  for  lip  were 


i  yv  i  yp 

L.  jip  =  Aj  tan-1  —  +  Az  tan"1  — 

XE  XP 


2.  lip  *  Aj  sin 


3.  tan  Up  =  Aj 


-1 


rn« (k  x  VP) 

VP  knl 


+  Aj  Xe  +  A^  Xp  (B-6) 

+  A2  (XE-Xp)  (B-7) 


ye 


+  A„ 


Vp 


xE  cos  Yp  xp  cos  Yp 


+  A3  tan  (XE~Xp)  (="5) 


4.  tan  lip  **  Aj  f j  +  A2  f2  4-  Aj  fjf2  +  A^  fj  +  A5  f2 


(3-9) 
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where  fj  »  V(xE-xp)2  +  (yE-yP)2  sgn  tan'1  j  ^  j  -  xP j  y/ 


(zE-zp)  cos  Yp 


(B-10) 


£2  »  V(Vx£“vxp)2  +  (VyE^yp)2  sgn  Ixe~Xp1/ 


{V2£**V2p)  cos  Yp 


(B-ll) 


None  of  the  above  egressions  for  tip  even  approximated  the  correct 
values  on  trajectories  other  than  those  used  in  evaluating  the  A^. 

In  evaluating  the  controls  that  minimize  (maximize)  r  at  any 
instant  it  should  be  noted  that 


r  »  (Vp.r  -  vp.r)/r 


(B-12) 


does  not  explicitly  contain  the  controls.  However,  the  controls 
appear  explicitly  in  r.  Thus  to  minimize  the  value  of  r  an  instant 
later  the  pursuer  must  minimize  r.  Using  the  standard  model  dynamics, 
and  setting 


3r 


d2r 


0,  ~->0 

3PP  3wp 


_ =  0,  3  r  >.  0 

3CUP  3clp 


gives 
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tan  lip  •  I(xE~Xp)  sin  Xp  -  (Ye-^  cos  Xpl/ 

t (xE-xp)  sin  Yp  cos  Xp  +  (yE~yp>  sin  Yp  sin  Xp 
-  (zE-Zp)  cos  Yp]  (B-13) 

and 

Cjj,  -  -  I  (xE-Xp)  (cos  pp  sin  Yp  cos  Xp  +  sin  pp  sin  Xp) 

♦  <yE-yp) ^cos  WP  sin  Yp  sin  Xp  “  sin  pp  cos  Xp)  . 

-  (zE-zp)  cos  Pp  cos  Ypl/ 

2kjp[ (xE-xp)  cos  Yp  cos  xp  +  (yE~yp]  cos  Yp  sin  Xp 

+  (zE-Zp)  sin  YpJ  (B-14) 

Similar  egressions  nay  be  obtained  for  the  evader's  controls. 

The  above  expressions  were  evaluated  at  a  number  of  points  on  the  1 
open-loop  minimax  trajectories  for  the  standard  model  and  compared 
with  the  open-loop  controls.  This  comparison  showed  that  the  above 
expressions  and  the  actual  controls  bore  little  or  no  resemblance  to 
each  other.  An  error  in  the  value  of  Pp  of  120*  was  not  unusual  and 
neither  the  sign  nor  the  magnitude  of  C^p  were  in  agreement. 

The  method  of  considering  each  instant  in  time  as  corresponding 
to  termination  meant  that  by  continuously  updating  the  transversality 
conditions  the  controls  could  be  evaluated.  Agreement  with  the  open- 
loop  minimax  controls  was  no  better  than  using  the  method  of  minimizing 
r.  The  two  methods  are  in  fact  probably  equivalent  to  each  other. 
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Appendix  C 

Plots  of  Some  Typical  Minimax  Trajectories 

This  appendix  contains  plots  of  the  minimax  trajectories  for  all 
three  models  integrated  backwards  in  time  for  10  seconds  starting 
from  four  different  terminal  states.  The  plots  are  shown  with  the 
trajectories  in  both  real  and  relative  space.  Additionally  there  are 
four  plots  forward  in  time  in  real  space  obtained  using  the  pseudo 
controls  developed  in  Chapter  VII  with  the  standard  dynamics.  These 
last  four  trajectories  were  obtained  using  as  starting  values  of  the 
state  variables  values  obtained  at  the  end  of  10  seconds  backward 
integration  of  the  standard  model. 

The  plots  were  obtained  using  the  Three-D  Calconp  routine  (Ref  2:1 
et  seq) .  The  values  of  the  terminal  parameters  used  for  the  four 
different  runs  were  chosen  to  be  typical  of  different  classes  of 
solutions  to  the  standard  model,  and  not  so  as  to  show  any  of  the 
models  to  particular  advantage  or  disadvantage. 

For  the  plots  in  real  space,  the  origin  of  the  axes  is  at  the 
point  where  the  pursuer  is  located  at  termination .  In  order  to  give 
a  better  feel  for  the  orientation  of  the  trajectories  in  space,  a 
ground  track  is  plotted  as  well  as  the  actual  trajectory,  and  vertical 
shading  is  provided  between  the  two.  The  vertical  shading  lines  are 
given  at  intervals  of  0.4  seconds.  The  Calcomp  routine  rescales  the 
axes  for  each  plot;  so,  in  order  to  give  an  idea  of  this  scale,  each 
axis  is  drawn  between  the  maximum  and  minimum  values  of  that  coordinate 
used  in  the  trajectories.  These  maximum  and  minimum  values  are  shown 
at  the  top  of  each  plot,  where  the  numbers  correspond  to  feet  in  actual 
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space. 


The  plots  in  relative  space  show  the  path  of  the  evader  relative  to 
the  pursuer.  The  position  of  the  pursuer  at  every  instant  is  taken  as 
the  origin  of  the  axes.  The  other  details  of  these  relative  space 
plots  are  the  sane  as  for  the  plots  in  real  space. 

In  order  to  simplify  comparisons  between  the  models  for  a  particu¬ 
lar  set  of  terminal  parameters,  the  plots  are  grouped  according  to 
parameters  used,  or  "Run",  and  not  according  to  model. 

The  aircraft  performance  parameters  used  in  obtaining  the  plots  are 
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Fi^ave  3.  Standard  T'oaol,  Foal  Space,  Run  1 
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Figure  4,  "ero  Gravity,  Fixed  Velocity  I'odel,  Heal  Space,  ?_un  1 
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STANDARD  MODEL-RELATIVE  SPACE 
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Ficure  6.  Standard  !!odel,  Relative  Space,  Itun  1 
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ZERO  GRAVITY*  FIXED  VELOCITY  MODEL-RELATIVE  SPACE 
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SThNuhRO  U'tNhMICS.  SYNTHESIZED  CQNTRQLS-REflL  SPRCE 
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53  0.001 

54  0.001 

55  1100.0 

56  0.1 

57  0.1 


Fi Cure  10.  Standard  Todel,  Real  Space,  Ran  2 
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ZERO  GRAVITY. FIXEO  VELOCITY  M0DEL-RERL  SPRCE 


01 

120^.0 

"2 

0.  '01 

03 

0.001 

04 

0.0C1 

S5 

1100.0 

So 

0.1 

S7 

0.1 

picr.o  ’;t  gaoo.o 

TT*  -7500.0  TTT  -5000.0 


v:  700.0 
r-  -5700. 0 


Ivr suer's  trajectory 


Uvader’s  trajectory 


GroundHracIc 


’-round  track 


Pi  pure  11.  Oero  Gravity,  Pixel  Velocity  Podc-l,  .leal  0-ace,  2 
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Yif'ure  1 2.  Spherics!  Yecto.iran  I'odel,  Yeal  Space ,  Yun  2 
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STANDARD  MODEL-RELRTIVE  SPACE 


51  1200.0 

52  0.001 

53  0.001 

34  0.001 

55  1100.0 

56  0.1 

57  0.1 


T"Z  10000.0  T/'X  200.0  T”_"  200.0 
XT*T'T  0.0  T'J!T  -5200.0  "IT:  -2400.0 


Figure  13.  Standard  "odel,  Relative  Space,  ?.ua  2 
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_  _  ..r- .  fl^rrv  unnn  DC  I  OTTUF  QPQPF 

ZEfiO  &HHV  1  >  T  »  f  1  ALU  VCLUllit  nuuLL-nuuimu  |,wt- 


31  12C0.0 
<32 

«33  O.GOI 

S4  0,001 

S-5  1100.0 

56  0.1 

57  0.1 


.m  —•*  *  «  •  A#*  A 


yo.o 
r"  -57“ o.o 


Position  of  pursuer,  0 


Trader's  trajectory 


Ground  tract 
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SPHERICAL  VECTOGRAM  MODEL-RELATIVE  SPACE 


rir-’-c  15.  Spherical  Voctoerra  "o^cl,  Relative  Space,  Run  2 
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o  ~ero  C-ravity,  Fixed  Velocity  I'odel,  Foal  Space,  Fun  3 


Figure  18 
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SPHERICAL  VECTQGRRM  MODEL-REAL  SPACE 


•'ll  1200.0 
"2  0.1 
*3  0.1 

54  0.1 

55  1100.0 

5 6  -o.l 

57  -0.1 


T'v:  5000.0  T'Xi  2600.0  —.V!  2SC0.0 

tt:  -3900.0  ri?r  o.o  tt  -200.0 


Pi cure  19. 


Spherical  Yecto^ran  Ilodel,  Real  Space,  Rita  3 
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STANOARD  MODEL-REAL  SPACE 


Yiftxre  24*  Standard  T'odel,  Real  Space,  Run  4 
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ZERO  GRfiVITT, FIXED  VELOCITY  MODEL-RERL  SPACE 
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STANOARD  MODEL-RELATIVE  SPACE 


Fi.nire  27,  Standard  To del,  Relative  Space,  TJun  4 
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